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Abstract. This paper is concerned with solutions to a one dimensional linear 
diffusion equation and their relation to some problems in stochastic control 
theory. A stochastic variational formula is obtained for the logarithm of the 
solution to the diffusion equation, with terminal data which is the characteristic 
function of a set. In this case the terminal data for the control problem is 
singular, and hence standard theory does not apply. The variational formula 
is used to prove convergence in the zero noise limit of the cost function for 
the stochastic control problem and its first derivatives, to the corresponding 
quantities for a classical control problem. 

1. Introduction. 

In this paper we shall be concerned with solutions to a linear diffusion equation 
and their relation to some problems in stochastic control theory. Let T > and 
b(y,t), y £ R, t < T, be a function differentiable in y with derivative continuous 
in (y, t) which satisfies the uniform bound 

(1.1) sup {\db(y,t)/dy\ :y€R, t<T}<A, 

for some constant A > 0. We shall be interested in solutions u e (x,y,t) to the 
equation 

(1.2) ^ + & ^)^+2# = < ^R,*<r, 

with terminal condition 

(1.3) lira u e (x, y, t) = for y < x, 

lira u e (x, y,t) = 1 for y > x. 

It follows from standard methods [7] that u s (x, y, t) is a continuous function of 
(x,y,t) for x,y G R, t < T, and that also the first derivative u e (x,y,t) in t and 
second derivatives in (x, y) exist and are continuous in (x, y, t). Evidently u e (x, y, t) 
is given in terms of the fundamental solution G e {y, y' , t, T) for (| 1 - 2[) by the formula 

/•OO 

(1.4) u £ (x,y,t) = / G e {y,y',t,T)dy'. 



It is well known [T^] that if &(•, •) satisfies (jl.lj) then the stochastic differential 
equation 

(1.5) dY e (s) = b(Y £ (s),s)ds + y/e dW{s), 
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where W(-) is Brownian motion, is uniquely solvable in the interval t < s < T with 
given initial condition Y £ (t) = y. Furthermore, u £ (x,y,t) is related to solutions of 
(|1.5p by the identity 

(1.6) u s (x,y,t)=P(Y s (T) >x\ Y e (t) = y) , t<T. 



The connection between solutions of (| 1 . 2[) . (|1.3p and control theory comes via 
the function q s (x, y, t) defined by 

(1.7) u e (x,y,t) = exp[-q e (x,y,t)/e]. 

In view of (|1.6p the function q E is positive, and by virtue of (|1.2[) . (|1.3p it satisfies 
the PDE 

ft s^ dq c , u ^ 9 ^ 1 (d<le\ 2 £ d 2 q e 

(L8) -at +b ^ t) ^-2\W + 2 W = Q " y ^ t<T > 

with terminal condition 

(1.9) lim q e (x, y, t) = oo for y<x, 

lim g e (a;, y, t) = for y > x. 

If we let e — ► in (|1.8p we obtain a Hamilton- Jacobi equation, and therefore should 
expect that the limit of q £ {x, y,t) as e — > is given by the solution of a variational 
problem. This turns out to be the case. Let q(x, y, t) be defined by 



(1.10) q(x,y,t) 




T r i / \ "i 2 



b(y(s) 



ds 



ds 



v(t) = y, y( T ) > x 



Thus the functional in (jl.lOp is minimized over all paths y{s), t < s < T, with 
initial point y(t) — y and terminal point y(T) > x. Define the function F(x, t), x € 
R, t < T, by F(x, t) — y(t) where y(-) is the solution to the terminal value problem, 

(1.11) ^ =b(y(s),s), S <T,y(T) = x. 

Then one easily sees that q{x, y, t) — if y > F(x, t), whence the function q(x, y, t) 
is nontrivial only for sufficiently large negative values of y. In §3 we prove the 
following theorem showing that q e converges to q as e — * 0: 

Theorem 1.1. Assume b(-, ■) satisfies 11.1)) . Then for x, y S R, t < T, < e < 1, 

there is a constant C depending only on x,y,t,T, A such that 

(1.12) \q e {x,y,t)~q(x,y,t)\<C^- 

Inequalities of the type p,12p for terminal data which is not singular- unlike in 
the case of (jl.9l) - have been known for many years [2 [4]. A short elegant proof of 
this has recently been given in [3] . The inequality (|1.12p implies via (II. 6p the large 
deviation result for solutions to the stochastic equation (|1.5p . 



(1.13) lim e log P (Y E (T) > x \ Y e (t) = y) = -q(x,y,t), 

s—>0 L 

a result which also follows from Theorem 1.1 of Chapter 4 of [8 . 

In proving Theorem 1.1 we take the approach of showing that in some sense 
q e (x,y,t) is the cost function of a stochastic control problem. The formal limit as 
e — > of this stochastic control problem is a classical control problem with cost 
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function q(x, y, t) given by (|1.10|) . The stochastic control problem can be described 
as follows: Let y £ {-) be the solution to the stochastic differential equation, 

(1.14) dy s (s) = X e (-,s)ds + ^/idW(s), 

where A e (-,s) is a non-anticipating function. The cost function for the problem is 

given by the formula, 

(1.15) 

[l f T 2 

Qe(x,y,t) = mmE -J [A £ (-,s) - b(y e (s),s)] ds y £ (t) = y, y e (T) > 

Thus the minimum in (jl. 15|) is to be taken over all non-anticipating A E (-,s), t < 
s < T, which have the property that the solutions of (|1.14|) with initial condition 
y e (t) = y satisfy the terminal condition y £ (T) > x with probability 1. One expects 
that the function q £ (x,y,t) of (|1.15|) is identical to the function q £ (x,y,t) of (jTTTJ) , 
but this is not so easy to prove. An immediate question that arises is how to define 
a suitable space of non-anticipating functions A e (-,s), t < s < T, which have the 
property that solutions of (j 1 . 14(1 with initial condition y £ (t) — y satisfy y £ {T) > x 
with probability 1. 

Instead of attempting to establish the formula (|1.15[) with q £ (x,y,t) given by 
(|1.7p . we shall confine ourselves to the simpler problem of showing that the ex- 
pectation on the RHS of (| 1 . 1 5[) is greater than or equal to q £ (x,y,t) for certain 
non-anticipating functions A £ (-,s), t < s < T, and that there is equality when 
A e (-, s) is given by the formula 

(1.16) A e 0,s) = X* e (x,y £ (s),s) = b(y e (s),s) - ^ (x,y e (s),s). 

dy 

In order to prove Theorem 1.1 it is actually only necessary to prove equality in 

(I1.15[) in the approximate sense 

(1.17) 

[\* £ {x,y E (s),s) -b(y e (s),s)\ ds y £ (t) = y 



Qs(x,y,t) = E 



The identity (| 1 . 1 7|) turns out to be much easier to establish than the equality in 
(fTT5f when X e (-,s), t < s < T, is given by (fTTT6)) . 

We turn to the proof of this equality in §4 and §6. In §4 we show that the 
solution y £ (s), t < s < T, of p,14[) with initial condition y £ (t) = y and X £ (-,s) 
given by the optimal controller p,16[) . has the property that 

(1.18) lim inf y £ (t) > x with probability 1. 

The proof of (|1.18p depends crucially on obtaining a lower bound on the derivative 
of the function q £ of (jTTTJ) , 

(1.19) -^( X7 y jt )>?LZl [l-r,(6)], 0<T-t<5, x- y<1 , 

where 7 is independent of 5 and lim^o rj(S) = 0. Observe that the inequality 
(|1.19p is only non-trivial for y < x since ~dq £ (x,y,t)/dy > 0, y £ R, by the 
maximum principle. The proof of (| 1 . 19[) relies on the use of the Cameron-Martin 
formula [21] applied to the diffusion Y £ (-) of (|1.5p . One can see from (|1.4p that 
the inequality (|1.19p gives some information about the short time asymptotics of 
fundamental solutions to diffusion equations. There has been much research over 
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several decades [ITJ HZl HH [22] devoted to this subject. In particular, Molchanov 
[18] has obtained short time asymptotic formulas for diffusions with bounded drift. 
These results have been used by Fleming and Sheu [B] to prove a representation 
formula analogous to (| 1 . 1 5[) for the logarithm of the fundamental solution. 

In order to establish that the expectation on the RHS of (|1.15p with X £ (-,s), t < 
s < T, given by (| 1 . 1 6(1 is equal to the LHS, one needs to prove that the inequality 
(|1.19| holds uniformly for y e R i.e. 7 = 00. This turns out to be a consider- 
ably more difficult task than proving (|1.19[) for some 7 > 0. It is not possible to 
obtain estimates by means of the Cameron-Martin formula, and instead one uses 
an induction argument. The problem of obtaining a uniform lower bound (| 1 . 1 9[) is 
closely related to the problem of estimating probabilities for the diffusion Y e (-) of 
()1.5j) tied at 2 different times. In §5 we prove the following : 



Theorem 1.2. Suppose b(-, s), < s < T , satisfies 11. 1]) and in addition 6(0, s) = 
0, < s < T. Then there exist positive universal constants, ?/, C%, C2, 71, 72 such 
that 



(1.20) P[Y e (t)< 



Ci(T-t)y 
T 



n(o) 

< exp 



y, Y £ (T) = 
li(T-t)y 2 

eT 2 



<-Ty/e/(T-t), 



(1.21) P ( Y e (t) > 



C 2 {T~t)y 
T 



provided AT < n, T-t< T/2. 



Y £ (Q) = y, Y £ (T) = Q 
l2(T-t)y 2 



< exp 



eT 2 



y < -Ty/ E /(T-t), 



In §6 we not only show that the expectation on the RHS of p,15[) with X £ (-,s) 
given by (|1.16j) equals the LHS. We also obtain corresponding formulas for the first 
derivatives of q £ (x,y,t) in x and y. An immediate consequence of this- Corollary 
6.1- is that the fundamental solution G £ for p.2[) satisfies the inequality 

1/2 

(1.22) G E (y, x, t, T) < [1 + (T — t)A]u E (x, y, t) 



-21ogu e (x,y,t) 



e(T-t) 

where A is the constant in (|1.1[) and u £ (x,y,t) is given by (|1.4[) . The inequality 
(|1.22| appears to be nontrivial even in the case b = 0, where it states that the 
cumulative distribution function N(-) for the standard normal variable, 



(1.23) 



N(z) 



cxp(-p 2 /2) dp = 



1 1 



sign(z) erf 



V2 



'2k J-co 22 
satisfies the inequality 

(1.24) exp(-2 2 / 2 ) < 2<SkN(z) [- logN(z)} 1/2 , z e R. 

Let us assume now that the function b(y,t), in addition to satisying (|l.ip . is 
also concave in y for each t < T. In §2 we show that in this case the function 
q(x, y, t) of (jl.lOp is C 1 in (x, y, t) and is a classical solution of the e = Hamilton- 
Jacobi equation (|1.8[) . Furthermore, for any t <T the function q(x,y,t) is convex 
in (x,y) and its second derivatives in (x,y) exist and are continuous on the set 
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{(x,y,t) : x,y £ R, t < T, 1/ / F(x,t)}, where F(x,t) is the function defined 
by p. lip . In the Appendix we prove using the method of Korevaar [9] [TO] [14] 
that the function q £ (x,y,t) defined by (jl.7p is also convex in (x,y) for any t <T. 
Although Korevaar's method is simple in concept, considerable difficulty arises 
here in its implementation due to the fact that we need to approximate solutions 
of the linear equation (|1.2|) by solutions of a quasi-linear equation (|A.34|) . Hence 
we need regularity theory-Proposition A2- for solutions to quasi-linear equations 
pj [TS] . Alternative approaches to Korevaar's method [TJ [TB] seem to also give rise 
to comparable technical difficulties in the implementation. 

The proof that for fixed (x,t) the function q e (x,y,t) is convex in y -Theorem 
Al-is much easier to establish than the joint convexity in (x,y). Using this fact 
and the representation theorem of §6 we prove in §7 convergence of first derivatives 
of q e (x, y, t) in (x, y) to first derivatives of q(x, y, t) as e — ► 0. 

Theorem 1.3. Assume &(•, •) satisfies fi.I)) and in addition that b(y,t) is concave 
in y for each t < T . Then q(x, y, t) is C 1 in (x, y, t) for t < T and 

dq £ dq 
(1.25) lim — 1 (x,y,t) = — (x,y,t), x,yeR,t<T, 

Ox OX 

lim — -(x,y,t) = — (x,y,t), x,y£H,t<T. 
e^o oy Oy 

Theorem 1.3 gives no rate of convergence as e — * like in Theorem 1.1, but if one 
assumes some Holder continuity of db(y,t)/dy in y, then the proof of the theorem 
yields a rate of convergence which is a power of e. It is of some interest to compare 
Theorem 1.3 to the results of Kifer [13] on the asymptotics of the fundamental solu- 
tion G e (y, x, t, T) defined by (|1.4p as e — > 0. In that paper asymptotic formulas are 
established by using the fact that G £ (y,-,t,T) is the probability density function 
for the random variable Y E (T) conditioned on Y £ (t) = y. Estimates on the proba- 
bility density are then obtained by using large deviation techniques [8]. Emphasis 
in the paper is placed on the local nature of the result. Thus the behavior of the 
drift &(•, •) far away from the minimizing trajectory in p,10[) is shown to be largely 
irrelevant. 



2. A Classical Control Problem 
Let b(y, s), y € R, s <T, satisfy (|1.1[) and consider the control dynamics 

(2.1) S = A(s) ' < - s - T ' y( t ) = y> 

where the controller A(s), t < s < T, is assumed to be piece- wise continuous. We 
shall be interested in the optimal control problem with cost function q(x, y,t), x, y S 
R, t < T, defined by 



(2.2) f) = nun jijf 



[\{s) - b(y(s), s)f ds y(t) = y, y(T) > x 



Formally the function q(x, y, t) of (12. 2|) satisfies the Hamilton- Jacobi equation, 
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Since the minimum in (12. 2p is over paths y(s), t < s <T, satisfying y(T) > x, the 
terminal condition on the PDE (12. 3|) is given by 

(2.4) 



lira q(x, y, t) = oo, 



y < x, 

lira q{x,y,t) = 0, y > x, 

The optimal controller A(-) for (|2.2|) is given by the formula 

(2.5) \(s) = \*(x,y(s),s)=b(y(s),s)-dq(x,y(s),s)/dy, t<s<T, 

and the Euler-Lagrange equation for the minimizing trajectory by 



as 



db / / \ s 



as 



= 0, t<s<T. 



Our first goal is to prove that there exists a minimizer for the variational problem. 
We have already observed that if F(-,-) is the function defined by p. lip , then 
q(x,y,t) = if y > F(x.t). Evidently in this case there is a unique minimizer 
2/(0 for (|2.2p . which is the solution to the differential equation p. lip with initial 
condition y(t) = y. For y < F(x, t) we need to define a space of functions y(s), t < 
s < T, over which to minimize the expression in (I2.2[) . For any / G L 2 [t, T] let y(-) 
be determined from / by 



(2.7) 



2/0) 



y 



f(s')ds'. 



Thus {/(•) is Holder continuous of order 1/2 on [t, T] and y(t) = y. We define Ex,y,t to 
be the space of all such functions y(-) with / e L 2 [i, T] and y(T) > x. The distance 
between 2 functions 2/1,2/2 € Ex,y,t is given by the norm ||yi — 2/2II = ||/i — /2II2, 
where y\ corresponds to /1 and yi to /2 in (|2.7p . Evidently the space E XtVtt is 
complete under this distance function. Now (|2.6p indicates that on a minimizer 
y(s), t < s < T, for (|2.2p the expression j/'(s) — b(y(s), s) does not change sign for 
s in the interval [t, T). We shall show that if y < F(x, t) the sign is in fact positive. 

Proposition 2.1. Assume the function b(-,-) satisfies Then there exists a 

minimizer y(-) £ E x y t of the variational problem i2.ty) . Any minimizer y(-) has the 
property that y(-) is C 1 in [t,T]. If y < F(x,t) then y'(s) > b(y(s),s), t < s < T. 
and y(T) — x. The function q{x, y, t) of &2.2\) is continuous for (a;, y) £ R. 2 , t < T . 

Proof. We define a functional J-[y{-)] on E x , y , t by 



(2.8) 



1 f 1 



x ~ b (y(s),s) 

as 



ds. 



Following the standard method [20, we show that is weakly lower semi-continuous 
on E x ^ Vyt - Thus let ?/Ar(-),-/V > 1, be a sequence in E x _ y j converging weakly to 
2/oo(0 € E X:Vi f Hence if /jv, N > 1, /oo inL 2 [t,T] are associated with y n (•), N > 1, 
and 2/oo(0 respectively, we have that 

feL 2 [t,T}. 



(2.9) 



lim (f,f N ) 



(/,/» 



From the uniform boundedness principle [2D] it follows that sup ||y*Ar|| 2 < 00. It also 



AT>1 



follows from (|2.9p that lim 2/at( s ) = 2/oo(s), t < s < T, and sup{|2/Ar(s)| : N > 

N^oo 
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1) t < s < T} < oo. Hence by the dominated convergence theorem one has that 



(2.10) 



lim 

JV->oo 



b(y N (s),s) 2 ds 



KVoo(s), s) 2 ds. 



Using the uniform boundedness of the /at, N > 1, we also have that 

lim / [b(y N (s),s)-b(y oo (s),s)]f N (s)ds = 0. 
Hence using (|2.9p again we conclude that 

rT 



(2.11) 



lim 

N^oo 



b(y N (s),s)f N (s)ds 



b(y o(s),s)f 00 (s)ds. 



Now ([2~TU|) . (|2"TTj) imply that 
Uminf^[yjv(-)] = ~ Uminf / 



dy N (s) 



ds 



b(yoo(s), s) 



ds 



ds 



ds + - 



b(yoo(s),s) 2 ds. 



The lower semi-continuity of on E x . Vtt follows from the inequality, 



f 


dyoo(s) 




ds 



ds < — liminf 

2 N^oo 



i: 


~dy N {s)~ 




ds 



ds, 



which is a consequence of the convexity of the Dirichlet form |20j . One easily 
concludes from the lower semi-continuity of the existence of a minimizer y(-) € 

Ex ,y,t- 

Suppose now y(-) € E x ^ y ^ is a minimizer for J-[-\. Then the first variation of !F[-\ 
about y(-) must be 0, whence 

rT r df(s) db ' 
— (y[s),s) ip(s) 



(2.12) 



ds 



dy 



dy{s) 
ds 



b{y(s),s) 



ds = 0, 



provided ip(-) is a C 1 function satisfying ip(t) = 0, <p(T) = 0. Setting 



ip(s) = ip(s) exp 

it follows from (|2~T2]) that 

rT dip 
ds 



(2.13) 



ds 



V{s)ds = 0, 



for all C 1 functions ip : [t,T] R with ip(t) = ip(T) = 0. Equation ([2~T5jl implies 
that 



(2.14) 



V(s) = constant, t< s <T, 



from which we may conclude that if y < F(x, t) then y'(s) > b(y(s) 7 s) for all s, t < 
s <T, and y(-) is C 1 . It also follows that y(T) — x, for if y(T) > x then there exists 
t\ < T such that if yi(s), t\ < s < T, satisfies yi{t\) = y(ti),y[(s) — b(yi(s),s), 
ti < s < T, then yi(T) > x. Evidently the function y*{s), t < s < T, defined 
by U*{ s ) = y( s ), t < s < t\, y*{s) — yi(s), t\ < s < T, is in E x ^ y j and satisfies 
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T y*(-) < T y(-) , yielding a contradiction. One can argue in a similar way to 
prove the continuity of the function q(x, y, t), (x, y) € R 2 , t < T. □ 

We have already observed that for y > F(x,i) there is a unique minimizer 
y(-) G Ex,y,t for the variational expression (|2.2| and it is given by the solution y(-) 
of equation (jl.lip with initial condition y(t) = y. For y < F(x,t) we need to impose 
some condition on the function b(-, •) beyond (jl.ip to guarantee a unique minimizer. 
To see what such a condition should be let us suppose that y(s), t < s < T, is a 
solution of the Euler-Lagrange equation (|2.6p with initial conditions satisfying 



(2.15) 



y{t) = y, y'(t)>b{y,t). 



Hence (|2.6I) implies that y'(s) > b(y(s),s), t < s < T. Suppose now that y(s) + 
(p(s), t < s < T, is also a solution to (|2.6[) with (p(t) — 0, f'(t) = e. Then to first 
order in e the function </?(s), t < s < T, satisfies the linear equation 



(2.16) 



ds 2 



d_ 

ds 



db 
dy 



(y(s),s)cp(s) 



db ^ d<p(s) 



fy (y(s) ' 5) 



ds 



<p(a) = 0. 



Suppose now that ^( T ) = f° r some r, t < t < T. Then on multiplying (|2. 16[) by 
ip(s) and integrating over the interval t < s < r we get 



(2.17) 



[ 


d(p(s) 


ds + 2j 




ds 





T db ^ dip(s) 



dy 



ds 



db 
dy 



~] 2 



2 -(y( s )> s ) 



where V(s) is given by the formula 

d 2 b 

(2.18) V(s) = - — 

Observe that by the Schwarz inequality we have 

fT ( dip(s) 



dy 
ds 



V ds 



ip(s) 2 ds 



%(s),s) 



db 



V(s)<p(sf ds, 



(p(s) 2 ds, 



with strict inequality in general. Thus if V(-) in (|2.18| is non-negative the expression 
(|2.17| is strictly negative in general. Since V(-) is non-negative if the function b(y, s) 
is concave in y, it appears that one gets a contradiction to the fact that (|2.17l) is zero 
when one assumes that b(y, s) is concave in y, t < s < T. We conclude therefore 
that the trajectories y(-) of the Euler-Lagrange equation (|2.6p which satisfy (|2 . 1 5[) 
are non intersecting. In particular, for y < F(x, t) there is exactly one which has 
the property that y(t) = y, y(T) = x . We make this argument rigorous in the 
following: 

Proposition 2.2. Assume the function b(-,-) satisfies (1.1]) and that b(y,s) is 
concave in y for y E R, s S [t, T]. Then the minimizer y(-) £ Ex,y.t of the 



variational problem (2.ty) is unique for all (x,y) € R 2 . Furthermore the function 
q(x, y, t) of {Up is C 1 for (x, y) €K 2 ,t<T. 
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Proof. Since the minimizer is clearly unique for y > F(x,t) we assume y < F(x,t). 
We show that the functional of (|2.8[) has a convexity property provided b(y, s) is 
concave in y, t < s < T. Let E be the set of (^functions y(-) on [t, T] which satisfy 
y'(s) > b(y(s), s), t < s < T. It is evident that E is convex in y for t < s < T, in 
the following sense: 

(2.19) yi (-), y 2 (-), \ yi (.) + (1 - \)y 2 (.) eE, 0<A<1, 

implies 

T [\ yi (-) + (1 - A)y 2 (-)] < XT [ Vl {-)\ + (1 - X)T [y 2 (-)\ . 
To prove ()2.19j) we write 



T[X yi {-) + {l-X)y 2 {-)] = 



%2(s),s) 



{b(Xyx(s) + (1 - X)y 2 (s), s) - Xb( yi (s), s) - (1 - X)b(y 2 (s), s)} 



ds. 



Since yi(-) 2/2(0 € E and b(y,s) is concave in y, t < s < T, each term in the last 
expression inside curly braces is non-negative. Assuming also that Ayi(-) + (1 — 
A)2/2( - ) G E we have that 



< 6(Ayi(s) + (1 - A)y 2 (s), s) - A%i(s), s) - (1 - A)6(y 2 (s), s) 



< 2 



A {it ~ %1(S) ' S) } + (1 ~ A) {ll " %2(S) ' S) } 



t < s < T. 



We conclude therefore that 



^[A yi (.) + (1-A)y 2 (0]<5 



A 



(I - \^^-b(y(s),s) 



{is ~ b ( y ^ ,s 

<XT[ yi (-)] + (l-X)T[y 2 (-)], 

and hence (|2.19|) holds. 

The uniqueness of the minimizer y(-) G E x . y j follows from the strict convexity 
of J-[-] in the sense of (|2.19p . Let us assume yi(-) J/2(') G E x . Vtt are two minimizers 
where y < F(x,t). Then by Proposition 2.1 the functions yi(-), Vi (•) are in the 
set E and for sufficiently small A > the function Ayi(-) + (1 — A)j/2( - ) is also in 

whence (|2.19[) implies that Ayi(-) + (1 — A)y 2 (0 is a minimizer. From the strict 
convexity of T\\ we have then that 

- b( yi (s), s) = ^- b(y 2 ( S ), s), t<s<T. 
as as 

Since y\{t) = j/ 2 (i) = V we conclude from this last identity that yi(s) = j/ 2 (s), t < 
s < T 1 , and so the uniqueness of the minimizer. 

To show that the function q(x, y, t) is C 1 we consider the optimal control A* (x, y, t) 
y'(t) where y{-) G E XtVt t is the unique minimizer for the variational problem (|2.2p . 
Evidently A*(x, y, i) = b(y, t) if y > -F(a;, i). We first prove that X*(x, y, t) is contin- 
uous in (x,y,t) for (x,y) £ R 2 , t <T. To do this let D x ^ y (5) c R 2 be the disc of 
radius S > centered at (x,y). Then there exists a constant Af(<5) > depending 
only on S such that 

2 



(2.20) 



i: 


dz(s) 




ds 



< K(S), z(-) G E x > >y t )t , {x', y') G £>x,»(*), 
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where z(-) is the minimizer of the variational problem. To see (|2.20|) observe that 



- 4 



T[z{ 

Now from one has that 



r 


dz(s) 






ds 





r 


dz 




ds' 



\b(z(s),s)\ < \b(z(t),s)\+A 



Hence from the Schwarz inequality we have that 

2 



b(z(s), s) 2 ds. 



ds', t<s<T. 



If 


dz(s) 


a J, 


ds 



ds-K'(S), 



where K'{8) is a constant depending on 8. Now (I2.20[) follows from this last in- 
equality and the continuity of the function q(-,-, i) on D x ^ y {8). 
Next we show that for any e > there exists 8 > such that 

2 



(2.21) 



i: 


dy 


dz 




ds 


ds 



ds<e, z(-)eE x > yV >, (x',y') e D XjV (S), 



where y(-) G E x ^ y>t is the minimizer for f|2 . 2|) and z(-) G E x > >y > jt is also the minimizer. 
The inequality (|2.2ip follows from the convexity (|2.19[) of the functional !F\-\. We 
first consider the situation y > F(x,t), where the minimizer y(-) G E X} y tt satisfies 
y'(s) — b(y(s), s) and q(x, y, t) = 0. Thus for e% > there exists <5i > and 

(2.22) F[z(-)]<e u z{-)eE x , tV , tU (x',y') G D XtV (Si). 

We can restate (|2.22p as z(-) satisfies the initial value problem 

dz 

— = b(z(s),s) + f(s), t<s<T, z(t)=y', 

where ||/||2 < V^ £ i- Putting now ip(s) = z(s) — y(s) it follows from (|1.1|) that <p(s) 
satisfies the initial value problem 

dip 
ds 



(2.23) 



a(sMs) + /(a), t < s <T, <p(t) = y 1 - y 



where sup |a(s)| < A. It follows that there are constants C\,C<i > such that 

t<s<T 



(2.24) 



sup |z(s)-y(s)| < Cily'-yl+CaViT. 

t<s<T 



We write the LHS of (|2~2"Tj) as 

' '[b(y(s),s)-b(z(s),s)} 



b(z(s),s) 



dz 
ds 



ds 



< 2 



[b(y(s),s)~b(z(s),s)] 2 + 4F{z(-)}. 



The inequality (j2~2"Tj) follows from this last inequality and (12~2"2")) , (12~2"I)) . 

We prove (|2.21|) for y < F(x, t). First let 8\ > be such that closure of D XiV {8{) 
lies in the set {(^',y') G R 2 : y' < F(x',t)}. Then it follows from (l2~2"TJj) that there 
exists Ao, < A < 1, such that 

Aqz(-) + (1 - Ao)y(-) G E, «(•) G J^,y/,t, fa', 2/') G A^i). 
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where y(-) G E x%y ,t and z(-) G E x t. y ^t are the minimizcrs for (|2.2jl . Since z(-) 
and y(-) are also in 23 we may use the convexity (|2.19|) of the functional In 
particular we have that 

F[\ z(-) + (1 - AoM-)] < A ^[z(-)] + (1 - Ao)^[y(-)] 

-Aq(I-Ao) f T ( dy dz ^ ~ 



Using the continuity of the function q(-,-,t) at we conclude from the last 

inequality that there exists 82, < 82 < Si such that 

(2.25) 

1 f T ( d dz 1 2 

2J \'dl~ -£ + b (4s),s)-b{y(s),s)[ ds<e 2 , z(-) e E x ,, y/ , t , (x' ,y') e D Xty (S 2 ), 

where again y(-) G E x/y _ t and z(-) G E x ^ y ^ t are the minimizers for (|2.2[) . Here 
£2 > can be chosen arbitrarily and 62 depends on £2. Now we may argue as for 
the case when y > F(x,t). Thus letting ip(s) — z(s) — y(s) we have that ip(s) 
satisfies the equation (|2.23p with H/H2 < V^2- Hence we obtain an inequality 
analogous to (|2.24|) , which together with (|2.25jl implies (|2.21| . 

The continuity of X*(x, y, t) in (2, y) follows easily from (|2.21[) upon using (|2.14[) . 
Thus for a minimizer of (|2.2p . z(-) G E x > >y i it one has 

dz r f s db 

(2.26) --b(z( S ),s)=A(x',y>,t)exp - J ^(z(s'), s')ds' ,t<s<T. 

where A* (x 1 , y',t) = b(y', t) + A(x',y', t). Evidently (|2T2Tj) implies that the function 
A(-, - ,t) is continuous at (x, y). Finally we observe that the continuity of A* (x, y, t) 
as a function of (x,y,t) for (x,y) G R 2 , t < T, follows from (|2.26p . In fact if 
y(-) G E x , V: t is the minimizer for (|2.2p then (|2.26p implies that for fixed x the 
function s — > \*(x 7 y(s), s) is continuous, t < s < T. Hence if we combine this 
with the previous argument on the continuity of A*(-, •. t) for fixed t we obtain the 
continuity of A*(-, ■, •) in all three variables. 

We prove the C 1 property of the function q(x,y,t), (x,y) G R 2 , t < T. First 
we observe that there is differentiability of the function q in a least one direction. 
Thus 



d 



1 



n 2 



(2.27) - — q(x,y(s),s) = - [X*(x,y,t) - b(y,t)] 

ds s=t 2 

where y(-) G E x _ y ^ is the minimizer for (|2.2p . We use the continuity of the function 
A*(-, •, •) to show differentiability in other directions. Let us assume that y < F(x, t) 
and Ay small enough so that | Ay\ < F(x, t) ~ y. Then 

1 r T 

(2.28) q(x,y + Ay,t)-q(x,y,t)< -- [A» - b(y(s),s)} 2 ds 



1 



[A* (a) - Ay/ (T -t)- b{y{s) + (T - s)Ay/(T - t), sf ds, 



where y(-) G E x . Vi t is the minimizer for (|2.2p and A*(s) = y'(s), t < s <T. Letting 
Ay — ► in (|2~2^|) we conclude that 



(2.29) lim sup [q(x, y + Ay, t) - q(x, y, t)] I Ay < 

Ay^Q 1 
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Alternatively let ?/a( - ) G E x ^ y+ /\ y j be the minimizer for 
s < T. Then one also has 



[X*(s)-b(y(s),s)]ds. 
and X* A (s) =y' A (s),t< 



(2.30) q(x,y + Ay,t)-q{x,y,t)> 



1 



[^*a( s ) ~ %a(s),s)] 2 ds 



[X A (s) + Ay/ (T - 1) - 6(y A (s) — (T — s)Ay/(T - t), s)} 2 ds. 



It follows from (|2.30|) by using (|2.2ip . (|2 . 26[) and the continuity of the function 
A*( v ,0 tliat 



(2.31) liminf [q{x,y + Ay,t) 

Ay^O 



q(x,y,t)]/ Ay > 



T -t 



ri + (T ~ S) S (2/(s) ' S) 



[\*(s)-b(y(s),s)]ds. 



The differentiability oiq(x,y,t) w.r. to y follows from ([2~29]) . (|2~3T|) . Using ([2~21"1l . 
f|2.26jl again we also see from the formula on the RHS of (|2.29| that dq(x, y, t)/dy 
is continuous in (x,y,t) for y < F(x,t), t <T. It is easy to extend this argument 
to show that dq(x,y,t)/dy exists for all y £ R and the derivative is continuous in 
(x,y,t) for (x,y) £ R 2 , t <T. This follows from the fact that the formula on the 
RHS of (I2~25)) is zero if y = F(x, t). 

One can see by a similar argument that q(x, y, t) is differentiable w.r. to x and 
that dq(x,y,t)/dx is continuous for (x,y) £ R 2 , t <T. Finally (|2.27jl and the fact 
that dq{x,y 1 t) / dy is continuous shows that q(x,y,t) is differentiable w.r. to t and 
dq(x,y,t)/dt is continuous in (x,y,t), (x,y) £ R 2 , t <T. We have shown that the 
function q(x, y, t) is C 1 for [x, y) £ R 2 , t < T. □ 

Corollary 2.1. Assume &(■, •) satisfies the conditions of Proposition 2.2, q(x,y,t) 
is the function defined by (2.2]) . and \*(x,y,t) is the corresponding optimal control, 
(x,y) £ R 2 , t <T. Then there are the identities, 

(2.32) dq(x,y,t)/dy = b(y,t) - \*(x,y,t), 

dq{x,y,t)/dt = i [\*(x,y,tf -b(y,t) 2 ] . 
Furthermore, for y < F(x,t) there are the inequalities 



(2.33) 



dq{x,y,t) 
dy 



<0, 



dq{x,y,t) 
dx 



> 0. 



Proof. We first show the identity (|2.32|) for dq(x,y,t)/dy. We assume y < F(x,t) 
since it is obvious otherwise. Using the fact that q{x,y,t) is the minimizer for the 
variational problem (|2.2[) we have that for A £ R, 

q(x, y,t)<^[\- b(y, tf At + q(x, y + XAt, t + At) + O [(At) 2 ] . 

Since q is C 1 this implies that 
(2.34) 

i [X*(x,y,t) 2 -b(y,t)] 2 <l[X-b(y,t)} 2 + [X- X*(x,y,t)]^(x, y> t), X £ R, 
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where we have used (|2.27[) . The inequality (j2.34|) implies the first identity of (|2.32l) . 
The second identity follows from the first identity and (|2.27j) . 

The first inequality of (|2.33|) follows from Proposition 2.1. To show that dq{x, y, t) jdx > 
we derive a formula for dq(x, y,t)/dx similar to the formula (|2.32[) for dq(x, y,t)/ dy. 
We have already seen that dq(x,y,t)/dx is given by an expression similar to the 
RHS of (j2~29)l . 

1 '\*(s)-b(y( S ),s)}ds. 



(2.35) ^-( X) y,t) = ^- 



l-(s-t) — (y(s),s) 



Adding (f2~2"51) and ([235)1 we conclude that 

(2.36) + |f fotf>*) = - [ f^( s ) s ) [**(s)-b(y(s),s)}ds. 

If we use now the identity (|2.26[) we conclude from the previous expression that 



(2.37) Iffr'W'*) = [^(x,y,t)-b{y,t)]exp 



dy 



where y(-) G E XtVtt 
dq(x, y, t)/dx > 0. 



is the minimizcr for 



Proposition 2.1 and (|2.37[) now imply 

□ 



Remark 2.1. Observe that Proposition 2.2 and Corollary 2.1 imply that q(x,y,t) 
is a classical solution to the e = Hamilton- J acobi equation \1.8\) . 

Next we show that q(x, y, t) is twice differentiable in (x, y). Since this is obvious 
for y > F(x, t) we consider y < F(x, t). Let ip(s), t < s < T, be the solution of the 
first variation equation (|2.16p with terminal data tp(T) = 0, <p'(T) = — 1. Then one 
should have the identity 

(2.38) d\*(x,y,t)/dy = </(t)/<p(t). 

We have already given an argument to show <p(s) > 0, t < s < T, if we assume 
b(-, s) is concave for t < s < T. Hence in this case the RHS of (|2 . 38[) makes sense. 
Note also that we may write (|2.16l) in the form 



(2.39) 



d_ 

ds 



db 
dy 



(y(s) 



dip 
ds 



db 
dy 



{y(s),s)ip(s) 



V(sMs) = 0, 



where V(s) > if b(-,s) is concave for all s, t < s < T. Hence it follows 
from (|2.39|) that if we assume the concavity of b(-,s) t < s < T, then ip'(t) — 
db/dy(y(t, ),t)cp(t) < 0. Thus from (|2~^|) . (j2~35|) we conclude that d 2 q(x 7 y, t)/dy 2 > 
0. We make this argument rigorous in the following: 

Proposition 2.3. Assume the function &(•,•) satisfies and that b(y,s) is 

concave in y for y £ R, s < T. Then the function q{x,y 1 t) of (2.2]) is convex in 
(x,y) for (x,y) € R 2 , t <T. Suppose in addition that b(y,s) is twice differentiable 
in y for y G R, s < T, and d 2 b(y, s)/dy 2 is continuous in (y,s). Then q(x,y,t) 
is twice differentiable in (x,y) for (x,y,t) € Ut = {(x,y,t) : (x,y) S R 2 ,t < 
T, y < F(x,t)y. The second derivatives of q(x,y,t) w.r. to (x,y) are continuous 
in Ut and satisfy d 2 q(x, y, t)/dx 2 > 0, d 2 q(x, y, t)/dy 2 > 0, d 2 q(x, y, t)/dxdy < 0. 
Furthermore, if (xq, yo, to) € dUr and to < T then 
(2.40) 



lim 

(x,y,t)^(x ,y ,t ) 



d 2 q(x,y,t)/dx z > 0, 



lim 

(x,V,t)—>(x ,yo,to) 



d 2 q(x,y,t)/dy z >0. 
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Proof. Observe that the function F(x,t), x £ R, t < T, defined by (II. lip is a 
convex function of a;. In fact one has 

<- T db 



dF , s 

(2.41) — (x,t)=exp 



dy (y(s),s)ds 



where y(s), s < T, is the solution to (jl.llj) . Hence by concavity of &(•, s), t < s <T, 
one has that dF(x,t)/dx is an increasing function of x. It follows that the set 
Vt = {{x,y) £ R 2 : y > F(x,t)} on which q(-,-,t) vanishes is convex. We also 
have from the argument of Proposition 2.2 that q(x,y,t) is locally convex on the 
not necessarily convex open set R 2 \V t . Hence q(x,y,t) is convex in (x,y) for all 
(x,y)£R 2 . 

We assume now b(y, s) is twice continuously differentiable in y for y £ R. s <T. 
We can write (|2.39p as a system 

(2.42) J - ^(y(s), S ) ( p(s) = -' l p(s) ) t<s<T, 

^ + f-(y(s), S )i>(s) = -V(sMs), t<s<T, 

where y(-) £ E x y t is the minimizer for (|2.2p . Evidently (|2.42p has a unique solution 
[ip(s),ijj(s)], t < s <T, with terminal data tp(T) = 0, ip(T) = 1. Multiplying the 
first equation in (|2.42p by ip(s) and the second by ip(s) we see on integration that 

(2.43) i>{sMs) = [ V(s') 2 + V(s')<p{s') 2 ds', t<s<T. 



From the terminal conditions on [(p(s),ip(s)] we have that tp(s) > 0, tp(s) > for s 
close to T. It follows then from (f!Q3"|) that ip(s) > 0, ip(s) > for t < s < T. 

Next we use (|2.26p to write the equation for the minimizer y(-) £ E XjVt t of (|2.2p 
in a form similar to ()2.42p . Thus we have 

(2.44) ^ - b(y(s),s) = -p(s), t<s<T, 
as 

dp <96 ..... , „ 

■£ + — (y(s),s)p(s)=0, t<s<T. 

In (|2.44p the first equation is the definition of the Hamiltonian momentum p(s) 
while the second equation is equivalent to (|2.26p . Suppose now z(-) £ E x t y i t is 
also a minimizer for (|2.2p and define <f>(s) = z(s) —y(s), ^(s) = P(s) — p(s), where 
P(s) is the momentum corresponding to z(-). Then since z(-) satisfies an equation 
similar to (|2.44[) we have that 

d$ f 1 db 

(2.45) — - *(a) J g^(Ms) + (1 - li)z(s), s) dfi = -*(«), t < s < T, 

d^ db f 1 d 2 b 

— + —(z(s),s)V(s) = -$(«)p(s) J q^(w(s) + (1 - /*)«(*), «) dfi, t<s<T. 

We consider now the situation where x' = x so $(T) = 0. Then if y' = y + Ay we 
may write 

(2.46) $(t) = a(Ay)¥(T), *(t) = /3(Ay)*(T), 
where the functions a(-) and /?(■) satisfy 

(2.47) lim a{Ay) = <p(t), Hm /3(Ay) = ^(i) 

Ay— ^0 Ay— *0 
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since the coefficients in the equations (|2.45p converge as Ay — > to the coefficients 
in the equations (12.42|) . Now we have that 



[X*(x,y + Ay,t)-X*(x,y,t)] j Ay 



) + (l- fi)z(s),s) dfi -*(t) 



Ay, 



and $(t) = Ay. Hence it follows from l|2.46[) . (I2.47|) that X*(x,y,t) is differentiable 
w.r. to y and 

(2.48) dX* (x, y, t)/dy = db(y, t)/dy - 1>(t) / <p(t). 

One also sees easily from the representation (|2.48l) that d\*(x, y, t)/dy is continuous 
in Ut and that the limit exists as (x,y,t) — » (xo,yo,to) £ dUr provided to < T. 
The fact that d 2 q(x, y, t) jdy 2 > follows now from (j232"j) and the fact that ip(t) > 
0, <p(t) > 0. 

We can similarly see that A* (x, y,t) is differentiable w.r. to x and d\* (x, y, t) jdx 
is continuous in Ut and the limit exists as (x,y,t) — > (xo,yoj^o) G 9C/t provided 
to < T. To see that d 2 q(x,y,t)/dxdy < we note that d 2 q(x,y,t)/dxdy = 
ip(t)/(p(T), where [(p(s),ip(s)], t < s < T, is the solution of ([2^42]) with initial 
data (p(t) = 0, = 1. We have in this case 

iK«M«) = - f V^(s') 2 + f( s ')^(s') 2 ^', 



whence y(T) < and so d 2 q(x,y,t)/dxdy is negative. 

To prove the twice differentiability of q{x, y, t) w.r. to x we use the representation 

(2.49) dq{x lV ,t)/dx = p(T), 

where p(s) is given by (|2.44|) for the minimizer y(-) G E Xj y ; t of (|2.2p . The differen- 
tiability of dq(x,y,t)/dx and the positivity of d 2 q(x,y,t)/dx 2 proceeds as before 
by representing d 2 q(x 1 y, t) / dx 2 in terms of a solution to (I2.42| . Finally we observe 
that ([2~gg]) follows from (|23S]l . ig^gl and (|2T55]l . □ 

Remark 2.2. Proposition 2.3 shows that all second derivatives of q(x,y,t) with 
respect to (x,y) have jump discontinuities across the boundary y — F(x,t). Hence 
q{x,y,t) is not C 2 in (x,y) for all (x,y) € R 2 . 



3. Proof of Theorem 1.1 

Our main goal in this section is to show that the function q e (x,y,t) defined by 
(|1.7p converges as e — * to the function q(x,y,t) defined by (|1.10[) . The formula 
(|1.15[) for q e (x,y,t) makes this intuitively clear, but it is not obvious under what 
circumstances the function defined by (|1.7p has the representation (|1.15p . As part 
of our proof of convergence we shall make use of various situations in which (| 1 . 1 5[) 
is valid. First we regularize the terminal data (|1.9j) . 

Lemma 3.1. Suppose &(•,•) satisfies II 1.1]) and q E (x,y,t) is given by jX 7[ ). Then 
there exists 5 > and universal constants C\,C% > such that if T — t < 5, e < 1, 
there is the inequality 

(3.1) Ci{x - y) 2 /(T -t)< q e (x, y,t) < C 2 (x - y) 2 /(T - t), 
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for y in the region 

(3.2) x-y>2 J \b(x,s)\ds + yJe(T -t). 

Proof. Since &(•, •) satisfies (jl.lj) one can uniquely solve the stochastic equation 
(|1.5[) with given initial data. The solution u e (x, y, t) of the terminal value problem 
(|1.2[) . (jl.3p is then given by the formula (|1.6p . Letting Z £ (s) = y e (s) — y, we have 
then that 



(3.3) Z £ (s) 



db 

dn—(fiY e (s r ) + {l-n)y,s') 



Z e (s')ds' 



b(y,s')ds' + y/e[W(s)-W(t)], s > t. 
Now applying Gronwall's inequality to (|3.3|) we conclude that 



(3.4) sup \Z e (s)\ < A(t,T) sup / b(y, s')ds' + Ve[W(s) - W(t)] 

t<s<T t<s<T Jt 

where A(t, T) is a constant depending only on t, T. The lower bound in inequality 
(|3~Tj) follows from ^) and fO]) . ([T7| . 

To obtain the upper bound we consider the stochastic process Z' e (s), s > t, 
defined by the equation 

(3.5) dZ' E (s) = [AZ' E (s) +b(x,s)]ds + y/edW{s), Z' e {t) = x~y, 

where A is the constant in (jl.ip . If t is the first hitting time at x for the process 
Y £ (s) of ([T3]l with F £ (t) = 2/, then it is evident that Z' E (s) > x - Y £ (s), t < s < t. 
It follows that 

(3.6) P(t <T)> P{Z' £ {T) < | Z' e (t) =x-y). 

Since the stochastic equation (|3 . 5|) is exactly solvable, we can estimate the RHS of 
(|3.6[) . Assuming x — y satisfies fl3.2[) we conclude that 

(3.7) P(Z' £ (T) < | Z' e (t) - x - y) > exp [-C(x - y) 2 /^ - *)] , 

for a constant C depending only on the parameter A in (13. 5|) . The upper bound in 
(|3.ip follows now from (|3.6|) . (13. 7|) . and the inequality 

(3.8) P(y e (T) > x I y e (t) = y) > P(t < T) inf P(F e (T) > a I y e (s) = x), 

t<.s<T 

since it is clear that for J small enough the infimum in (|3.8p is larger than 1/4. □ 

We consider a controller A e (j/, s), i/£R, s < T, which is uniformly Lipschitz in 
y for £ < s < T — S. Thus there is a constant C such that 

(3.9) \X e (y,s)-X e (y',s)\<C\y-y'\, y,y' e R, t < s <T — 8. 

Hence we may solve the stochastic differential equation (jl.!4j) for i < s < T — S. 
We show that in this case the the expectation on the RHS of (|1.15[) is bounded 
below by the LHS. 

Lemma 3.2. Suppose A E (-,-) satisfies hS. 9\) and &(•,■) satisfies U.l\ ). Then if 
q s (x,y,t) is given by JJ.7| ) there is the inequality 

( 1 f T ~ S 

(3.10) q e (x,y,t)<El- [X e (y e ( S ),s)-b(y e (s),s)} 2 d S 
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+ q £ (x,y e (T - S),T - S) | y e (t) = y 
where y e (-) is the solution to the SDE 

Proof. Let V e (y,s), y € R, s < T - 5, denote the RHS of (j3~Tu) . Arguing as in 
Lemma 3.1, one sees that 

(3.11) 0<V £ {y,s)<Ay 2 + B, yen, t<s<T-6, 

for some constants A, B. In addition V s , dV £ /ds, dV e /dy and d 2 V e /dy 2 are all 
continuous functions of (y, s), i/eR, i < s < T — S, and satisfy the equation 
(3.12) 

BV BV f B 2 V 1 9 

it + Ae (y ' s) + 2 ~W + 2 [A(y ' s) " s)] °' y e ^ * - s < T " * 

with terminal condition 

(3.13) V s (y,T - 5) = q e (x,y,T - 5), y e R. 

Note that the twice differentiability of Ve(y, s) with respect to y uses the fact 
that the function A e (-, s) — &(•, s) is Lipschitz continuous for t < s < T — 5 (see [7] 
Chapter 1, Theorem 9). From (|1.8|l . (|3. 12[) we conclude that the function W e (y, s) = 
V E (y, s) — q E (x, y, s) satisfies the PDE 

BW E . , , s dW e e 8 2 W E If,, » , 99e n2 



-+A £ (y,s)- 



A £ (y,s) - &(y,s) + 

dy 



0, y€R,t<s< T-S, 



8s By 2 dy 2 

and all the derivatives 8W e /Bs, 8W E /By, 8 2 W e /By 2 are continuous. Furthermore 
by (|3.13p the terminal condition for W e is W e (y,T — S) = 0, y G R. It follows then 
from Lemma 3.1, p. lip and the maximum principle (see [7] Chapter 2, Theorem 
9) that W e (y,t) > 0, y G R, whence the result follows. □ 

Lemma 3.3. Suppose &(•, •) satisfies 1 1.1]) . Then for x, y G R, t < T, and e < 1, 
i/iere is i/ie inequality 

(3.14) fcfo y, t) < y, i) + y, t, T)^, 

where q{x,y,t) is given by 111.10]) and C(x,y,t,T) is a constant independent of e. 

Proof. Let y(s), t < s < T, be a minimizer for (JTTTUJ) , whose existence has been 
established by Proposition 2.1. We set X e (y,s) = A(s) = y'(s), y G R, t< s <T, 
and apply Lemma 3.2, taking S = y/e. We consider first the case y < F{x,t) so 
y(T) = x. Hence x — y(T — S) < C^fe for some constant C. It follows then from 
Lemma 3.1 that 

(3.15) E{q £ (x,y e (T-S),T-S) | y e (t) = y} < C iy /i 

for some constant C\. Here we are using the fact that y e (s) — y(s) = s/e [W(s) — 
W(t)} and that q E (x, y,T — 5) is a decreasing positive function of y G R. We can 
similarly see that 



1 



T-S 



(3.16) E UJ t { x (s)-b(ye(s),s)Yd s yS) = v) <q(x,y,t) + c 2 ^. 

for some constant C 2 - Thus (|3. 14|) follows from (|3.15[) (|3.16p in the case y < F(x,t). 
For y > F(x,t) we may use the same argument, noting that q s (x,-,T — (5) is a 
decreasing positive function. □ 
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To obtain a lower bound for q E (x,y,t) corresponding to the upper bound estab- 
lished in Lemma 3.3 we shall need to use the fact that the function dq e (x, y, s)/dy 
is uniformly Lipschitz continuous in y for (y, s) in any region {(y, s) : y > yo, t < 
s < T — 5}, where S > 0, i/oeR can be arbitrarily chosen. 

Lemma 3.4. Suppose &(•,•) satisfies and u £ (x,y,t), t < T,y S R, is the 

unique bounded solution to HI. 2\ ), H 1.3\) . Then for any S > 0, i/o € R, t < T , there 
is a positive constant C(S,yo,t) such that 

(3.17) u e (x,y, s) > 1/(7(5, j/O) *)i 2/ > 2/o, t<s<T-5, 

\du E (x,y,s)/dy\ + \d 2 u e (x,y,s)/dy 2 \<C(S,yo,t), y > y , t < s <T - 6. 

Proof. To prove the first inequality in (|3.17[) we proceed as in Lemma 3.1, using the 
representation (|1.6[) . Since the solution Y e (s) of (| 1 . 5j) which has initial condition 
Y £ (t) — y satisfies the inequality (|3.4[) . it follows that there exists y\ > x with the 
property that u e (x, yi,s) > 1/2, t < s < T. We consider now y in the interval 
2/o < y < Hi- Let a be defined by 

a = inf [b(y', s) : y - 1 < y' < y lt t < s < t}, 

and Z £ (s) satisfy the stochastic equation 

dZ E {s) = ads + dW(s), Z e (i) = y. 

Then Y" e (s) > Z e (s), t < s < r, where r is the first exit time of Z e (s) from the 
interval [yo — l,j/i]. We can easily estimate from below P(t <T, Z e {r) = y{). 
Combining this with (|3.4p we see that the first inequality in (|3.17p holds for yo < 

y<yi- 

We turn to the problem of estimating the derivatives in (|3 . 1 T[) . Let y\ € R 
and T\ < T. We shall be interested in constructing the solution to the terminal- 
boundary value problem 

dw dw e d 2 w 

wiy,^) = w (y), ye[yi-7], yi + v], 

w{yi - 77, s) = w-(s), w(yi + 77, s) = w + (s), s < T x , 

where 77 > and the functions wo(-), ui-(-), tf+(-) are assumed to be continuous on 
their domains. The solution to l|3.18p can be represented in terms of the Dirchlct 
Green's function G(y,y' ,t,T\) for the problem. Thus 

(3.19) w{y,t)= G(y,y',t,T 1 )w (y')dy'+ 

Tl dG, , f Tl , , ,dG 



( 3 - 18 ) — + b (y,t) — + 77 — = 0, yi-r)<y<yi + v, t<T u 



dsw-(s) — (y,y 1 -r},t,s)-e J ds w+(s) — (y,y 1 + r),t, s). 

We shall show that the Green's function may be constructed by perturbation ex- 
pansion provided t < T\ lies in an interval t £ \T\ — A, Ti] where A, 77 satisfy the 
inequalities 
(3.20) 

A < 77 2 /e, A < vej [sup ||6(y, s)| : y x - r? < y < Vl + v , T x - A < s < Ti}] , 
for some v < 1 independent of 6(-, •) and e. 
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We construct the Green's function by the standard method [7|. Thus let Gd(u, y' , t) 
be the Green's function for the heat equation on the interval [—1,1] with Dirichlct 
boundary conditions. The function Go is given from the method of images as an 
infinite series, 



(3.21) 



G D (y,y',t)= £(-l)fM G(y-y' m ,t), 



m—0 



where y' = y' and y' m , m > 1, are the multiple reflections of y' in the boundaries 
— 1, 1, with p(m) being the parity of the reflection, p(0) = 0. The function G(y,t) 
is a Gaussian with mean and variance t. We now set K(y, y', t, s) to be 
(3.22) 

K(y,y',t,s) =T]- 1 G D ([y-y 1 }/ri,[y l -y 1 }/ri, e{s-t)/i] 2 ), y, y' G fe/i-77, yi+r?], i < s - 

The Green's function G(y,y',t 1 Tx) is formally given by an expansion in terms of 
the function K. Let £t,y denote the operator on the LHS of (|3.18p . so (|3.18|) is 
£t,yW = 0. Then 



(3.23) G(y,y',t,Tx) 



K{y,y' \t,Tx) v n (y,y' ,t,Tx), 



n=0 



Ti 



ds 



yi+v 



dz K(y, z, t, s)g n (z, y' , s, T x ), 



'Vi-V 

£t, v K(y,y',t,Ti), 



yi+n 



dz £ t ^ y K(y, z, t, s)g n (z, y' , s, Tx). 



v n (y,y',t, T i) 
go(y,y',t,Tt) 
9n+i(y,y' ',t,Tx) 

One easily obtains from (j3.23|) the estimate 
(3.24) 

\g n (y, y', t, T x )\ < C n [sup { \b(z, s)\ : y x - V < z < Vl + V , t < s < Tx} 
(Tx - t) n ' 2 - V2 



n+l 



~(n+l)/2 



G(y-y',2e(Tx-t)), n = 0,l,2, 



for some universal constant C, provided ij > y/e(Tx — t). It follows from (|3.24|) that 
the series expansion (|3.23p for the function G converges provided t £ [Tx — A, T], 
where A, rj satisfy (|3.20[) for some sufficiently small universal v > 0. In that case 
one has the following estimate on the Green's function: 

(3.25) G(y,y',t,Tx)<C G(y-y',2e(Tx-t)), 

for a universal constant C > 0. 

We can obtain estimates for the derivatives of G analogous to (|3.25p by differ- 
entiating the expansion p.23[) term by term. We first consider dG(y,y',t,Tx)/dy'. 
For t € [Tx — A, Tx] and A, 77 satisfying (pHO)) . We have from (PT2"3"j) that 



(3.26) 



^(y, y', t, Tl )\ < JL- t ^ G(y - y> , 2e(Tx - t)) 



for some universal constant C. The integral representation in (|3.23p for dvo (y, y',t,Tx)/ dy' 
gives rise to a non-integrable singularity in the integration with respect to s, t < 
s < Tx, if we use (I3.26p . We therefore need to use the fact that go(z,y' , s,Tx) — 
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b(z, s) dK(z, y', s, T\)jdz and integrate by parts with respect to z in the represen- 
tation (|3.23p for vo(y,y',t, T%). We conclude that 



(3.27) l^fo.y^Tx) 



< 



A 



Ti-t 



1/2 



CG^-j/MTi-t)) 



for some universal constant G, where ^4 is the upper bound in on the derivative 
of &(•, •). We can use a similar method to obtain a bound on the derivative of g\. 
Thus we have 



(3.28) ^(yy.t.Tx) 



< 



.4 



CG( I /-» / ,2e(T 1 -t)) 



for some universal constant G. Choosing A now to also satisfy A < \JvfA we 
conclude from (|3.28[) and the representation (|3.23|) for g n that 
(3.29) 



< 



l /("+ 1 )/ 2 (T 1 -<)"/ 2 
,/e A(™ +1 )/ 2 



-G" G(y-y',2e(T x -t)), 



1,2, 



where C is a universal constant. The estimate (|3 . 29[) gives an estimate on the 
derivatives of v n , n > 1, 



(3.30) 



9v n . , . 
-^7 (v,V,t,Ti) 



< 



I/ (n+l)/2( Tl _ t )«/2 



G" G(y- 2 /',2 £ (T 1 -<)). 



A(™ +1 )/ 2 

for a universal constant C. We conclude then from (j3.27j) . (I3.30|l that on choosing 
^ > sufhciently small in a universal way, the function G(y, y' , t, T\) is differentiable 
with respect to y' for t € [T\ — A, Ti] and 

dG{y,y',t,T 1 )\ . C 



(3.31) 



< 



v^PR 



G(y-y',2 £ (T 1 -i)), 



for some universal constant G. Hence the integral representation (|3.19p is well- 
defined for A, j) satisfying ((3T20|) and t G [Ti - A, Ti]. 

We can obtain estimates on other derivatives of G by a similar method. Observe 
that from (|3.24ll we may conclude that G(y,y' ,t,T\) is differentiable with respect 
to y for t e [Ti - A, Ti] and 



(3.32) 



9G(y,2/,f,Ti) 



<9y 



< 



G 



G( I /-i/ / ,2e(T 1 -t)) J 



for some universal constant G. To obtain an estimate on d 2 G(y, y', t, Ti)/dy 2 we 
must first obtain estimates on dg n (y, y', t, T\)/dy. Evidently we have that 



(3.33) 



dy 



< 



A 



VWi - t) (Ti - <)ViA 



GG(y-y',2 £ (Ti-t)) 



for some universal constant G. To estimate dg\{y,y',t,Ti)/dy we write the inte- 
gral representation (|3.23p as an integral over t < s < (T% + t)/2 plus an integral 
over (Ti + t)/2 < s < T x . Since the integral over (Ti + 1)/2 < s < T x , may be 
estimated using (|3.24|) we concentrate on the integral over t < s < (Ti + t)/2. 
Now the kernel Ct,yK(y, z, t, s) which appears in the integral representation (|3.23p 
for gi is a sum of terms generated by the boundary reflections which occur in the 
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representation (|3.21j) for Gd- We consider the principle term in this series, which 
makes a contribution to the representation for g\ given by 
(3.34) 



f(y,y',t,T 1 ) = 

-(T 1 +t)/2 

I 

(T 1 +t)/2 



(Tx+t)/2 



ds 



yi+v q 

dz b(y,t)—G(y - z,e(s - t))g (z, y' , s,Ti) 

Vi—V 



dy 



ds 



Vl+r> dgo 

dz b(y,t) G(y - z,e(s - t)) — {z,y',s, T{) 

yi—Tj 



ds b(y, t) G(y -yi+r), e(s - t))g Q (y 1 - 77, y' , s, Ti) 



(T 1 +t)/2 



ds b(y, t) G{y - y x - 77, e(s - t))g (y 1 + 77, y', s,Ti). 

Denoting the first integral on the RHS of (|3.34[) by I\(y) we see from p. 331) that 

h(y) is differentiable with respect to y and 

(3.35) 



^(y)\ < \a(Ti -t) + MTi ty/z/VA 



A 



#Wj (7i - t)VeA 



C G{y-y' ,2e{Ti- 



for some universal constant C . Let I^iy) denote the second integral on the RHS of 
([334} . Using the fact that 
r S 



ds 



■ exp 



2es 



(es) 3 / 2 [ Z£i 'J J^/eS 
we see that ^2(2/) is differentiable w.r. to y and 



dz e- z/2 /ez l 



/2 



(3.36) 



dh{y) 



(hi 



< 



V 

7a 



1/2 



.4 



A(Ti - 1) 



1/2' 



CG{y-y'MT x -t)) } 



for some universal constant C. We get a similar estimate to f|3 . 36[) for the third 
integral on the RHS of (|3.34p . It is clear that the higher terms in the series (|3.21[) 
for Ct >y K(y, z, t, s) make smaller contributions to dgi/dy than the RHS of (|3.35p . 
([3361 - We conclude that 
(3.37) 



< 



Ti-t 



1/2 



A 



A(Ti - 1) 



1/2 



CG(y-y'.2e(Ti-t)), 



for some universal constant C . Using the representation (|3.23[) for g n +i we can now 
see by induction that 
(3.38) 



— {y,y ,t,Ti) 
dy 



< 



(Ti-t) 



f \n - 1/2 



A- 



A(Ti - i) 



1/2' 



-1 n+1 



C"G(j/-y / ,2 £ (T 1 -t)) ) n>0, 



for some universal constant C. We may use (|3.24|) and (|3.38j) to estimate the second 
derivative of the function v n (y, y', t, T±) in (I3.23| with respect to y. Thus we have 
(3.39) 



2 Vn 

dy 2 



{y,y',t,Ti) 



< 



(Ti - ty 



A 



A(Ti - t) 



1/2' 



n+1 



C n G( 3 /- V , ,2e(Ti-t)), n > 0, 
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for some universal constant C. We conclude then from ()3.39j) that G(y,y' ,t,T±) is 
twice differentiable with respect to y for t € pi — A, Ti] and 



(3.40) 



dy 2 



< 



C 



e(Ti - 1) 



G(y-y'MT x -t)) 



for some universal constant C. 

Next we wish to estimate d 2 G(y,y' ,t,Ti)/dydy' . We can easily obtain this 
from the representation (|3.23[) for v n and (|3.29[) . Thus from (|3.29[) we can esti- 
mate d 2 v n (y,y' ,t,Ti)/dydy' for n > 1. We need to integrate by parts to estimate 
d 2 v (y, y', t, Ti)/dydy' just as was the case for the estimate p.27[) . We conclude 
that 



(3.41) 



a 2 G(y,y',t,T 1 ) 



dydy' 



< 



C 



e(Ti - 1) 



G(y-y',2 S (Ti-t)) 



for some universal constant C, provided t € pi — A, Ti] . Finally we need to estimate 
the derivative d 3 G(y,y',t,Ti)/d 2 ydy'. To do this we must first obtain estimates 
on d 2 g n (y, y', t, T{)/dydy' . Evidently we have that 
(3.42) 



d 2 g (y,y',t,T 1 ) 



dydy' 



< 



1 



e(2i - 1) 



A 



A(Ti - t) 



1/2' 



CG(y-y', 2e(T 1 -t)) > 



for some universal constant C. To estimate d 2 gi(y,y',t,Ti)/dydy' we write the 
integral representation ()3.23j) for gi as an integral over t < s < (Ti +t)/2 plus an 
integral over (Ti +t)/2 < s < T\. The second integral cannot be bounded by using 
(I3.2G|) so we need to resort to integration by parts as we did for the estimate (|3.27l) . 
To bound the contribution to g\ from the integral over t < s < (Ti + 1)/2 we use 
the representation (|3.34|) . We conclude that 



(3.43) 



d 2 9i 



dydy 



■j(y,y',t,Ti) 



< 



A 



A(Ti - 1) 



1/2' 



CGiy-y'MTr-t)), 



for some universal constant C . Now by induction we see from the representation 

(|3~23| for g n that 

(3.44) 



d 2 g n 



dydy 



-j[y,y' ,t,Ti) 



< 



[T x - ty 



A 



A(Ti - 1) 



1/2 



C n G(y-y' \2e(T x -t)), n > 0, 



for some universal constant C. Similarly to how we obtained (|3 . 39[) from (|3 .38[) we 
conclude from J3.44[) that 
(3.45) 



dh 



dy 2 dy 



7 G/. iAt.ro 



< 



(Tx - t) n - 



r3/2 



A 



A(Ti - 1) 



1/2' 



n+1 



C n G(y-y' 1 2e(T 1 -t)), n>0, 



for some universal constant C. We conclude then from (|3.45p that provided t £ 
pi — A,Ti], there is a universal constant C such that 



(3.46) 



9 3 G(y j2 /',t,Ti; 



dy 2 dy' 



(y^'it,^) 



< 



C 

[e(Ti - i)] 3 / 2 



G(2/-2/,2 £ (Ti-i)). 
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We use the estimates ([3732]) . ([3740]) . ([3741]) and ([3746]) to obtain bounds on the 
derivatives in ()3.17|) . In (|3.19|) we set w(y,t) = 1 — u £ (x,y,t), where the bound- 
ary functions wo, w+ are all bounded by 1. Then we estimate the derivatives of 
u £ (x, y, t) with respect to y by setting y = yi and estimating dw(y, t)/dy, d 2 w(y, t)/d 2 y 
at y — j/i using the Green's functions estimates. It is clear then that by choosing 
A to be given by its maximum value in ()3 . 20(1 that we get an estimate 

(3.47) \du e (x, y, s)/dy\ + \d 2 u £ (x, y, s)/dy 2 \ < C(6, y , Vao ,t) 

for (y, s) in any interval yo < y < yoo, t < s < T — 5. Our final task is to show 
that the constant C(S, yo, yoo, t) can be chosen independent of j/oo as j/oo — > oo. To 
see this we use the fact that the boundary functions uuo,W-,w + converge to as 
yi -> oo. 

Let Y s (s), t < s < T, be the solution of the stochastic equation (|1.5j) with 
Y £ (t) — y, where y > x. We need to estimate P(Y £ (T) < x \ Y s (t) = y) as y — ► oo. 
To do this we let Z £ (s) be the solution to the equation 

(3.48) dZ £ {s) = [-A Z £ {s) + b(x, s)] ds + y/edW(s), s > t, Z s (t)=y- x, 

where A is the upper bound in (|1.1[) for the derivative of b(-,-). Then Y £ (s) > 
Z £ (s) + x, t < s < t, where r > t is the first hitting time at for the diffusion 
Z £ (s) with Z £ (t) — y ~ x. The solution to p.48p is given by 

(3.49) Z £ (s) = (y - x)e- A( - s -V + f e'^ 8 " 1 ^ b{x, s')ds' + s > t, 



where £, £ (s) satisfies the stochastic integral equation 



(3.50) £ £ (s)=-AJ ( e (s')ds' + ,/£W(s), s>t. 

Applying Gronwall's inequality to (|3.50|) we have that 

(3.51) sup Ms)\ < e A( - T -V yfl sup \W(s)\. 

t<s<T t<s<T 

We can estimate the probability that inf t < s <T Z £ (s) < by using the inequality 



(3.52) P sup \W{s)\ >a) < 

\t<s<T 



8(T-t) 



1/2 



exp 



2(T-t) 



Let us assume that the second term on the RHS of (|3.49|) is smaller in absolute 
value than 1/2 the first term for t < s <T. This can evidently be accomplished by 
choosing y — x sufficiently large. Then from (I3.51|) . (|3.52j) we conclude that 
(3.53) 



P inf ZJs) < < 

\t<s<T j 

Using the inequality 



8(T-t) 



1/2 



2V£e 2A ( r -*> 

(y-x) 



exp 



(y - x) 2 
8e(T-t)' 



,-4A(T-t) 



P (Y £ (T) <x\Y e (t)=y)<P( t inf T Z e (s) < 



we obtain from (|3.53p bounds on the boundary functions wq , w_ , w + in (|3.19l) • 
Evidently these are decaying exponentially in y\ as y\ — > oo, whereas it follows 
from (|3.20p and the Lipschitz condition (|l.ip on &(•, •) that we may take A ~ l/i/^ 
as yi ~ * oo. We conclude that (J3747J) holds uniformly as j/oo — * oo. □ 
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Lemma 3.5. Suppose b(-, •) satisfies Then for x,y G R, t < T, and e < 1 

there is the inequality 

(3.54) q e (x, y, t) > q(x, y, t) - C(x, y, t, T)s/e, 

where q(x,y,t) is given by il.lU\) and C(x,y,t,T) is a constant independent of e. 
Proof. Suppose yo < x and y > yg. Then by Lemma 3.4 we have the representation 



(3.55) q e (x,y,t)=E 



(T-<5)At 

[Ae (Ve(s),s) - b(y e (s),s)} 2 ds 
+ q £ (x,y e (T-5)AT), (T-S)At) I y £ (t) = y 



Here X e (y, s) is given by the formula 

(3.56) X e (y,s) = b(y,s) - dq e (x,y,s)/dy, y € R, s < T. 

By Lemma 3.4 the function X e (y,s) is uniformly Lipschitz in y for y > yo and 
t < s < T — 8. Hence (I1.14[) has a unique solution y e (s), t < s < (T — S) At, where 
r is the first hitting time at yo- 

We consider a random path y £ (s), t < s < T — 6, for which r > T — 6, and 
associate with it a classical path y £:C (s), t < s <T. To do this let k be defined by 



(3.57) 



k = max 



x — 6 — y — 



T-8 



X e (y s (s),s)ds, 



Then y £jC (s), t < s < T, is the solution to the initial value problem 
d VsA s ) 



(3.58) 



ds 

dy e ,c( s ) 
ds 



= X e (y e (s),s) + k/(T-t-8), t<s<T-S, 
= 2 + b(y e , c (s), s), T-6<s<T, y e , c (t) = y. 



Since from (|3.57|) one has that y e , c {T — 8) > x — 5, it follows that y E . c {T) > x 
provided 8 is sufficiently small. Hence from (I1.10[) we conclude that 



(3.59) 



dy £ ,c( s ) 
ds 



&(Z/e,c(s),s) 



ds > q(x,y,t). 



From fH4]l . ([335)) we see that 
(3.60) ife,c(*) - tfe(*) - HS ~ I ] 



+ y/e [W(s)-W(t)}, t<s<T-S. 



(T-t-S) 

We may also rewrite the parameter k in (|3.57|) as 

(3.61) k = max[x-S-y s (T-S)+y/e[W(T-S)-W(t)], 0]. 

Observe now that 

(3.62) 



1 

2Jt 



(T-S) 
T-S) 



2 1 

[X e (y e (s),s)-b(y e (s),s)\ ds > - 



(t-s) r 



d y E , c ( s ) 
ds 



1 2 



KVe,c( S )> S ) 



ds 



dy e ,c( s ) 



ds 



%e,c(s),s) 



\b(y s , c {s), s) ~ b(y e (s), s) - k/(T -t-S)\ ds. 



Evidently from (|3 . 59[1 the first term on the RHS of (|3 . 62[1 is bounded below by 
q(x,y,t) — CS for some constant C. Using (|3.61|) and Lemma 3.1 we may bound 
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the second term on the RHS of (|3.62|) . First observe that this second term is 
bounded in absolute value by 

(3.63) 1 [X e (y E (s),s)-b(y e (s),s)} 2 ds + 



2 



(T-S) 

Hy s Js),s) - b(y e (s), s) - k/(T - * - 6)} 2 ds, 



for any 77 > 0. From (|3.60|) and the Lipschitz condition on &(•, •) the second 
term in (|3.63|) is bounded above as 

(3.64) / [b(y E , c (s), s) - b(y e (s),s) - k/(T - t - 5)f ds 

rT-5 

<de J \W{s) - W(t)} 2 ds + 2 k 2 , 

where the constants Oi, O2 depend only on T — t, assuming S < (T — t)/2. Hence 
from f3~FT|) . (j3~B3l) . (jBTMj) we conclude that the second term on the RHS of (|3~B2l) 
is bounded by 



(3.65) \ { [X £ (y £ (s),s)-b(y e (s),s)} 2 ds + 9ll f [W (s) - W(t)} 2 ds 
2 Jt V Jt 

+ — [W{T -6)- W(t)f + — {max [x - S - y e {T - 5), 0]} 2 , 
V V 

for any 77, < rj < 1 and constants Ci, C2, C3 depending only on T — t. It follows 

then on taking i] ~ 5 in (|3.65|) and using Lemma 3.1 that 



1 



(T-S) 



(3.66) q s (x, y e {T -5),T-6) + -l [X e (y e (s), s) - b(y e (s), s)] z ds 

> q(x, y, t) -CxS-^- J [W(s) - W(t)f ds + 0(e) 

-^{W(T-6)~W(t)] 2 -C 4 6 £ T S) [X £ (y £ (s),s)-b(y e (s),s)] 2 ds, 

for constants 01,02,03,04 depending only on T — t. 

To conclude the proof we take the expectation of (|3.66[) on a set of paths y e (s), 
t < s < T — S, for which r > T — S. To find a suitable set of paths note that 
dq e (x,y, s)/dy < 0, y S R, s < T, whence (|3.56[) implies that X e (y,s) > b(y,s), 
y G R, s < T. Thus y e (s) > Y E (s), t<s< T-S, where Y E (s) is the solution to (fT3|) 
with l^(t) = y. We have already estimated the fluctuation of Y e (s), t < s < T, 
from y by (|3-4[) . We therefore conclude that for given y we may choose yo < y such 
that 

(3.67) sup \W(s) - W(t)\ < 1/Ve implies t > T - 5. 

t<s<T 

The inequality (|3.54p follows now on taking S = ^fe in ()3 . 66(1 and taking the expec- 
tation on the paths for which (|3.67|) holds. □ 

Proof of Theorem 1.1. Evidently (|1.12jl follows from Lemma 3.3 and Lemma 3.5. 

□ 
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4. The Optimally Controlled Process 



In Lemma 3.5 we already used the optimally controlled process y £ (s) of (|1.14l) 
with controller (|1.16p to obtain a lower bound on q e (x,y,t). The main goal of this 
section is to prove that liminf s ^T l/e( s ) > x with probability 1. To do this we need 
to prove some short time asymptotic results for the cost function q e (x,y,t). 

Lemma 4.1. Suppose that 0<T — t < 6 < e < 1. Then the function q e (x,y,t) 

satisfies the inequalities 

(4-1) 

< q e {x, y, t) < Ce+{x-y) 2 l{T-t)+C( Xl 5) [(y - x) 2 + \y-x\ + ^Je{T - t)] , y < x, 

0<q £ (x,y,t) <Cscxp[-{x-y) 2 /2e{T-t)]+C(x,6) [(y - x) 2 + \y - x\ + ^e(T - t)] , y > x, 

where C is a universal constant and C(x, 5) depends only on x and 5. The function 
dq £ (x 1 y,t)/dy satisfies the inequality 
(4,2)' 

C(x, 6){(T- t)\ log(T - t)| + [(T - i)/e] 1/2 + (y xf/e + \y- x\/e) 



dq e , ., . x - y 



for a constant C(x, 5) depending only on x and S. 

Proof. We apply the Schwarz inequality in the PDE (|1.8p for q E (x,y,t). Thus for 
any a > 0, 



(43) ^ + hM ^y--2 il - a) \-dy- 
Setting v a (y,t) = exp[— (1 — a)q e (x, y, t)/e], we see from (|4.3[) that 



(4-4) 



dv a e d 2 v a (1 — a) 



Ot + dy 1 2 8y 2 



< 



2ae 



[b(y,t) -b(x,t)] v a , 



provided a < 1. It follows now from ()4.4ll that v a is bounded below by 
(4.5) 



v a {y,t) > E 



exp 



(1 - a)[b(y + g(s) + y/e W(s - t),s) - b(x, s)\ 2 ds/2ae 



v a (y + g(T) + ^W(T-t),T) 

where W(-) is Brownian motion and g(-) is given by 
(4.6) g(s) = J b(x, s')ds', t<s<T. 

Observing that v a has terminal data v a (y,T) = for y < x, and v a (y,T) = 1 for 
y > x, we conclude from (|4.5|) that 

: exp 



(4.7) v a {y,t)> 



1 



C _ 9( T) V 2 ^(T ~ *) L 2e(T-t) 
where -F(y, z) is given by the formula 

i-T 



F(y,z) dz, 



(4.8) F{y,z)=E 



exp ■ 



(1-a) b([(T-s)y+(s-t)z]/(T-t) 
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+ y/I[W{s -t)-(s- t)W{T - i)/(T - t)\ + g(s),s) - b(x, s) 2 ds / 2ae} 



In ()4.7j) we have used the Brownian bridge representation for Brownian motion 
conditioned at times t and T . Using Jensen's inequality in (|4. 8[) and the Lipschitz 
bound (|1.1[) on &(■,■), we conclude that 



(4.9) -logF(y,z)< 



A 2 (l-a) 
2ae 



ds E 



{(T-s)(y-x) 



+ (s- t)(z - x)]/(T -t)+ g(s) + Vi [W(s -t)-(s- t)W(T - t)/{T - t)])' 
ds |[(T - s)(y - x) + (s - t)(z - x)]/(T - t) + g(s)} 2 



A 2 (l-a) 
2ae 



A 2 (l -a) 
2a 



ds (s-t)(T-s)/(T-t) 



It follows now from (I4.6[) and (|4. 5|) that for any S > there is a constant C(x, S) 
depending only on x, 5 such that 



(4.10) -logF(y,2)< 



A 2 (l-a) 
2ae 



(z-x) 2 (T-t) + (y-x) 2 (T-t) 



+ C(x,S)(T-t) 3 + s(T-t) 2 /6 



, T~t<5. 



We may combine (|4.7|) . (|4.10[) to obtain an upper bound on q e (x,y,t). Thus on 
using the inequality (z — x) 2 < 2(z — y) 2 + 2(y — x) 2 in (I4.10|) . we conclude from 
(1471) that 



(4.11) 

v a (y,t) > exp 



1 



A 2 {l-a) 
2ae 

: exp 



{3(?/ - x) 2 (T - t) + C(x, 6)(T - i) 3 + E (T - f) 2 /6} 
1 yl 2 (l-a) 



*-V-9{T) v /27r£ ( T *) 

Let us recall the inequality 



2e(T - i) ae 



■(T-t) 



(4.12) 



1 



1 



e~ a I 2 < 



e - 2 /2 dz < £ e -a 2 / 2) 
a 



a > 0. 



We shall use it to show that there is a universal constant C such that 
(4.13) 



-* 2 / 2 dz > 



exp 



a + 1/ 



rj 2 /2 — C?7max{a, 1} 



To see this observe that by Jensen's inequality 



-* 2 ' 2 dz > 



exp 



a+r) 



V 2 /2 - 77 (Z) 



2/2 dz, 77 > 0, a e R. 



where Z is the standard normal variable conditioned on Z > a. Evidently if a < 2 
then I (Z) I < C\ for some universal constant C\ . If a > 2 we see from (|4.12j) that 

-1 



(Z) < a 1 - 



1 



< 4a/3, 
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whence ()4.13|) holds for all a £ R. 

We shall apply the inequality (I4.13| in (|4.11|1 to obtain an upper bound on 
q e {x, y, t) in terms of the cumulative distribution function (f> for the standard normal 
variable. Now the integral with respect to z' on the RHS of (|4.11|) is given by 



(4.14) 



y-x + g{T) 
[l + 2A2(l-a)(T-t)]V2 ' I y fflr - t) 



[l + 2A 2 (l-a){T-t)] 



1/2 



if we set a = T — t. We write the argument of $ in (|4.14l) 



a = (x — y)j \J e(T — t) and apply (|4.13p . Thus we obtain the inequality 



-[a + rj\ with 



y-x+g(T) 




[l + 2A 2 (l-a)(T-t)] 1/2 ) > 



{(y-x) 2 + \y-x\ + y/e(T-t)} 



T-t < S < e, 



for some constant C(x, 5) depending only on x, S. If we combine (14. 15|) with (14. lip , 
taking a — T — t, we obtain an upper bound on q £ , 



(4.16) q e (x, y, t) < -s log $ ([y - x]/y/e(T - 1) ) + 



C{x,S) (y-x) 2 + \y-x\ + y/e(T-t) 



T-t<5<e, 



for a constant C(x, S) depending only on x and <5. The inequality (14. ip follows from 
(|4.16p on using (|4.12|) . Note that (|4.12p for y < x follows from (|4.16p on using the 
fact that log a < a 2 / 2 for a > 1. 

Next we turn to estimating dq e (x,y,t)/dy. To do this we consider the Green's 
function G(y, y', t, T) of H3]). It follows from (H]) that -du e (x, y, t)/dx = G(y, x, t, T). 
If we differentiate (jl.2p with respect to y and use the maximum principle, we see 
also that 



(4.17) 



du e (x,y,t)/dy > e 



— A(T—i) 



G(y,x,t,T), 



where A is the Lipschitz constant in (jl.ip . Since —dq £ (x, y, t)/dy — e [du £ (x, y, t) / dy]/u e (x, y, t), 
we may obtain the lower bound (|4.2p by finding a lower bound for G(y, x, t, T) and 
a lower bound for q £ (x,y,t) which is complimentary to (|4.16p . 

We turn to the problem of obtaining a lower bound for q e . Instead of (|4. 3[) we 
use the differential inequality 

2 



(4.18) ^ + b(x,t)^-l(l + a) 



dy 



e d 2 q e 



dt v ' 7 dy 2 
for any a > 0. Setting v a (y,t) = exp[— (1 

(4.i9) «„(»,*)< r j 

Jx-g(T) ^J2lT£(T - t) 

where -F(y, z) is given by the formula 
(4.20) 

l ' T A 2 (l + a) 



[b(y,t)-b(x,t)] /2a <0, 



2 9j/ 2 

a)g e (a;, y, t)/e] we see from (|4.18p that 

{y-z? 



exp 



2e{T - 1) 



F(y,z)dz, 



F{y,z) 



E 



exp 



2ae 



ds 



(\T-s)(y-x) + (s-t)(z-x)]/(T-t) 
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+ g{a) + V~e [W(s - t) - (s - t)W(T - t)/(T - t)]f} 



The expectation in (14.20)1 cannot be evaluated exactly as was the case with 
but it may be estimated using the fact that one knows the probability density 
function of sup W(s — t). Taking a = T — t in (|4.20l) . we see from this that 

t<s<T 

(4.21) 

C A 2 

\ogF(y,z) < \{z-xf + {y-xf + C(x,S)(T -tf + e(T -t)) , T-t<5, 

e 

for a universal constant C and constant C(x, 6) depending on only x, S. Note here 
that we require 8 < 1/A 2 for the expectation (|4. 20[) to be finite. To obtain the 
lower bound on q 6 we combine (|4.21l) and (|4.19[) with the inequality (I4.13|) . Since 
we are obtaining an upper bound on the function v a (y,t), we apply (|4. 13)) with 
a + r\ = (x — y)/ \J e(T — t). Hence we get an inequality complimentary to (|4.16l) , 

(4.22) q e (x,y,t) > -e log$ ([y - iJ/V^M ) - 

C(x, S) [(J/ - xf + \y - x\ + ^e(T - t) ] , T-t<5<e, 

for a constant C(x, 6) depending only on x and d. 

The lower bound for G(y, x, t, T) may be obtained in a similar way to the upper 
bound on q e (x,y,t). Let < A < T — t and < a < 1. Then just as in (|4.5| we 
have that 



(4.23) G{y,x,t,T) 1 - a > 



1 



-co v /2 7 re(T - t - A) 



exp 



U ' : F A (y, z) G(z + g(T - A), x,T — A, T) 1-Q dz, 



2e(T-t - A)_ 

where Fa is as in (|4.8p but with T replaced by T — A. Observe that we cannot 
take A — > on the RHS of (|4.23p since the integrand would contain in the limit 
S(z + g(T — A) — x) 1_Q , which is identically zero. We shall choose A so that 
< A << T — t and a — T — t, in a way that the function z — > G(z + g(T — 
A),x,T — A,T) 1_Q is approximately a Dirac delta function concentrated at x. 

It is evident that the RHS of (|4.23[) is decreased upon replacing G by the corre- 
sponding Dirichlet Green's function Go for an interval centered at a;. As in Lemma 
3.4 we choose this interval sufficiently small and A sufficiently small so that Gd 
may be expanded in a perturbation series. The condition for this has already 
been given in ([3T20]> . Thus the Green's function G D (z, x, T - A, T) on the interval 
x — r) < z < x + r) has a convergent perturbation expansion provided ?y, A satisfy 
the inequalities 

(4.24) eA<rf, A<vej \Ar\ + C(x, S)] 2 , A < 5, 

where A is the Lipschitz constant from (jl.ip and C(x, 5) is a constant depending 
only on x, S. In that case there are universal constants C\, C2 such that 



(4.25) / G D (z,x,T- A,T)dz> 1 - C 2 exp[-r? 2 /4eA] 

J x — rj 

-C 2 [Ar] + C(x,8)]{A/£) 1 / 2 , < A < S. 
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Observe that if we take A = (T - t) 3 , n = (T - t)*/e then the RHS of (|4T2"5j) is 
bounded below by 1 — C(x, S)(T — t) for < T — t < S < e, where C(x, 5) depends 
only on x and S. Taking a = T — t we may see further that with the same values 
for A, 77 there is the inequality 
(4.26) 

rx+ri 

/ G D (z,x,T-&,T) l - a dz > l-C(x,5)(T-t)\log(T-t)\, 0<T-t<S<e, 

J X — Tj 

for a constant C(x,6) depending only on x, S. It follows then from (|4.10p . (I4.23[) . 
(|4~26| . that 



(4.27) 

1 r (v - x) 2 

G(y, x, t, T) > , exp - ^ y rrrl ' s 

y ' ~ y/2TTe(T - 1) I 2e(T-t) 



C(x,S){(T-t)\\og(T-t)\ 



+ {y-x) 2 /e+\y-x\/e} 



<T -t < 6 < e, 



for a constant C(x, S) depending only on x, S. 

To obtain the lower bound (j4~2|) we combine (|4~22]) and (|427)l using (|iT7|) . The 
inequality (|472]) now follows from (|4.12|) . □ 

Remark 4.1. There is a vast literature on short time asymptotics of solutions 
to diffusive equations. See in particular the classical papers of Kannai [11] . Mi- 
nakshisundaram |17j . Molchanov [IS] , and Varadhan [22] . 

Lemma 4.1 shows that for y < x and s < T with T — s small, the optimal 
controller A*(x,y,s), given by (|1.16[) for the stochastic control problem (|1.15p . is 
approximately A* (a;, y, s) = (x — y)/(T — s). This will enable us to show that the 
solution y e (s) of the corresponding stochastic differential equation (| 1 . 14[) satisfies 
liminf y £ (s) > x with probability 1. First we show this for the linear approximation 

which we have just established. 

Lemma 4.2. Suppose fi > 0, e > and Z e (s), t < s < T , is a solution to the SDE 

(4.28) dZ £ (s) = ~' iZ(s) ds + ^I dW(s), 

T — s 

with initial condition Z E (t) — z G R. Then lim Z £ (s) = with probability 1, and 

s — >T 

if /1 > 1/2 then liminf Z £ (s)j\/T — s = —00 with probability 1. 

s — >T 

Proof. The SDE (|4.28[) is explicitly solvable, whence we find 

(4.29) Z £ (s)= (jz^" z + V~e f (fr^f dW(s'), t<s<T. 

Thus Z e {s) is a Gaussian variable with mean of order (T — s) M as s — > T. We shall 
assume wlog that /j > 1/2, in which case the variance of Z £ (s) is order T — s as 
s — > T. Hence the standard deviation of Z £ (s) dominates the mean for s — > T. For 
n= 0,1,2...., let s„ = T-(T-£)/2™, so i = s < Si < s 2 < ■ ■ ■ < T. For t < s < T 
we consider the Martingale M(s) defined by 

M{s) = f (T-s')-k dW(s'), 
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which by Doob's inequality satisfies 



P[ sup \M(s)\ > a) < 2^-^ n /a 2 (2n~ \)(T - i) 2 ^ 1 , aril. 

,t<s<s„ / 



It follows that 

V p( sup \M(s)\ > < oo. 

^ \t<s<s n ) 

Hence by the Borel-Cantelli lemma limsup (T — s) M |M(s)| = with probability 1. 

We conclude from (|4.29[) that lim Z e (s) = with probability 1. 

We turn to showing that liminf Z e (s) j y/T — s = — oo with probability 1. For 

n = 1,2, ... we define variables Y n by F„ = (T - s„)^ 1/2 [M(s„) - M(s n _i)] . Wc 

may write the Z £ (s n ) in terms of the y„ as 

(4.30) 

^W=ferf z+y/e(T-s n ) W2 ( - m)( ^ 1/2) , n = l,2,-... 



m— 1 



Evidently the Y n , n > 1, are independent and Gaussian with zero mean and vari- 
ance var(y„) = [l — 2 1_2m ] /(2fi — 1). By the Borel-Cantelli lemma for any K > 0, 
one has Y n < —K for infinitely many n, with probability 1. Thus if in (|4.30[) we 
were to replace the sum over 1 < m < n by its dominant term m = n, we would 

have shown that liminf Z s (s) j ' \JT~- s„ = — oo with probability 1. 

n — >oo 

To take account of the sum in (|4. 30[) we need to make a more elaborate argument. 
Denoting the sum in (|4.30p by £„ it is easy to see that 

(4.31) = Y n + £ n _ 1 /2^ 2 \ n > 1, 

where £o = 0. For £ € R, n > 1, we put 

n) = P[^ m > a, 1 < m < n | £ = £] , 

where the £„ are defined by the recurrence ()4.31|) . Setting S = l/2^ -1 / 2 ^ < 1, it is 
easy to see that the n) satisfy the recurrence equation 

n> 1, 



(4.32) u (£,n) = -== j # «(^, n - 1) exp [-(£' - 5$* /2a* 

where we define it(£,0) = 1, £ G R, and a 2 = [l - 2 1 ~ 2 ^]/(2^ - 1). If for 
z > 0, z) is the Laplace transform of n), 

oo 

u(e, z) = X] «(£ ^e"" 2 , £ G R, z > 0, 

n=0 

then we see from (|4.32[) that 



poo 

/ ^'u(r,z)exp[-(e'-^) 2 /2a 2 ], £GR, *>0. 



(4.33) 4 ( f , z) = l + 7 = 
It follows from (|Q5|) that for ry > 0, 

(4.34) sup z)e-" e ] < + e~ 2 sup «)e -1 *] sup 
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where h v (£) is given by the expression 

1 r°° 

h v (0 = ^== / ^'exp[^'-0~(e'-^)7 2 ^]- 

V27TcH Ja 

Evidently sup h n (£) = 1 if rj = Q. We shall show that there is an r\ > such that 
sup h v (ti) < 1. 

To see this we shall assume wlog that a < and < ry < 1. We choose a to 
satisfy 6 < a < 1, and for £ > consider the integral 



POO 



exp ritf -Q-tf- <5£) 2 /2a 2 



erexp 



Tj(l-^ 



exp 



A" 



- C 2 /2 



where -fC = [a — <$]£/cr. We have now that 



exp 



K 



wC-C 2 /2 



-c 2 /2 



K—r\<7 



l>oo 

< exp [77V + C*(A' - w)w] / e _c2/2 d(, 



where we have used (|4.13p and assumed K — no > 1. Taking C > 1 and choosing 
a so that {1 — 5) > C(a — S), we conclude from the last 2 inequalities that there 
exists £o > depending only on a, a, such that 

d? explritf - 5Sf /2o* 

at 1 

< exp [ - r?£{(l - 6) - C(a - 5)}] / d£'exp - (£' - ^) 2 /2a 5 
provided £ > £o- It easily follows that 

(4.35) < exp[-pnt], £ > Co, < 77 < 1, 

where p = min [(1 — <5) — C(a — 5), 1 — a] . One can also see that we may choose 
j] > sufficiently small such that sup h„(£) < 1. Combining this with (14. 35[) . we 

a<e<fo 

conclude that sup h v (£) < 1 for sufficiently small r\ > 0. Now on letting z — ■> in 
dUgg) , we see that 



oo 



> a, I < m < n 



£o = £) < oo. 



Hence by the Borel-Cantelli lemma liminf £ ra < a with probability 1. Now (|4.30|) 

n — >oo 

implies that liminf Z £ (s n ) I \JT — s n = — oo with probability 1. □ 

n — >oo 

Theorem 4.1. Let A e (-, •) &e </ie optimal controller defined by 13.56\) . Then the 
SDE &1.14]) has a unique strong solution y £ {s), t < s < T, with initial condition 
Ue(t) = y, Furthermore liminf y £ (s) > x with probability 1. 

s — >T 
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Proof. To show existence and uniqueness of a solution to (|1.14|) we argue as in 
Lemma 3.5. Thus for yo < y let r(yo) = inf{s > t : s < T, y e (s) = yo}. Since 
A e (2/', s) > b(y', s), y' e R, s < T, it follows that lim PMy ) < T) = 0. Hence 

by the Lipschitz property of A E (y', s) for y' > j/o, t < s < T — 8, for any <5 > 0, we 
obtain a unique strong solution to (|1.14|) up to time T — 5. Letting 6 — > we get 
existence and uniqueness in the interval t < s < T. 

To show that lim inf y £ (s) > x we consider for yo < y solutions y £ (s), t < s < T, 

s — >T 

of (|1.14|) with y £ {t) = y such that r(y ) = T. From (I4.2|) and the fact that &(•, s) is 
uniformly Lipschitz for t < s < T, we see that there exists so with t < sq < T, and 
fio > 0, such that such that 

(4.36) dy e (s)>(b(x, S ) + ^^^^jds + ^dW(s), s <s<T, 

on paths y £ (-) for which r(yo) = T. It follows then from (|4. 36[) and Lemma 4.2 that 
on paths y £ (-) for which t(j/o) = one has in fact lim inf y e (s) > a; with probability 

s — >T 

1. Letting yo — > — oo, we conclude that lim inf y e (s) > x with probability 1 on all 

s — *T 

paths y £ (-) for which y £ (t) = y. 

Next for i] > and s < T let [/^ )So = {y e (-) : y e (i) = y, y £ (s) > x - rj, s < 
s < T\. If 77 and T — sq are sufficiently small it follows from (|4.2p that we may 
take fiQ > 1/2 for a path y £ (-) £ U VtSo . Hence by Lemma 4.2 we have that 
lim sup [y £ {s) — x\j \JT — s = +00 with probability 1 for all paths y £ (-) G U VjSo . 



Since lim So ^r P(U, hSo ) — 1, we conclude that limsup [y £ (s) — x]/y/T — s — +00 

s^T 

with probability 1 on all solutions to (|1.14[) with y £ (t) = y. 

For K > we define a stopping time tk by tk = inf {s > t : s < T, y £ (s) — 
x = K\JT — s} . We have just shown that P(jk < T) = 1. Consider now a 
solution y £ (s) to (|1.14j) for s± < s < T with initial condition y £ (s\) = y%. Now 
Ve(s) > Y £ (s), si < s < T, where Y £ (s) is the solution to (|1.5[) with Y £ (si) = y\. 
From (|3.4p we conclude that 

(4.37) inf y e (s)>id-C sup / 6^, s')ds' + y/i [W(a) - W( Sl )] 

si<s<T Sl <s<T J Sl 



for some constant C. We take now s\ > t and y\ = x + K\JT — s\ in (|4.37p . It is 

clear that there is a constant Kq > such that for K > Kq, 

(4.38) 

P ( inf y £ (s) < x ) < P ( Ve sup |W(s) - W(si)| > K^T - sJ2 ) < Ae/K 2 

\ Sl <s<T J \ Sl <s<T J 

Taking Sj = tr- in (|4.38|) we conclude that for K > K one has P(liminf y £ (s) < 
x) < Ae/K 2 . Letting K — > 00 yields the result. □ 

Corollary 4.1. Let X £ (-,-) be the optimal controller defined by \3.56\) , and y £ (s) 
be the corresponding solution to with initial condition y £ (t) = y. Then one 

has 



(4.39) lim qJx, y £ (T - 5), T - 5) = with probability 1. 

5 — *0 
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Proof. We use the second inequality of (|4.1j) to obtain an estimate on q £ {x 1 y, T— 8) 
when y > x. Since q £ (x, •, T — S) is a positive decreasing function we have that 

(4.40) q £ {x,y,T-6) < Ceexp [-(x- y) 2 /2eS] +C 1 (sS) 1/4 1 x < y < x + (eS) 1/4 , 

q £ (x,y,T^S)<C 1 (e6) 1 /\ y>x + {e5) 1 '\ 
for some constants C, C\. Now (|4.39[) follows from (|4.40p and Theorem 4.1. □ 



5. Proof of Theorem 1.2 

The problem of estimating dq £ (x,y,t)/dy is closely related to the problem of 
estimating certain conditional probabilities. For < 6 < T/2 we shall consider the 
conditional probability P(Y e (T - S) £ U \ Y £ (0) = y, Y £ {T) = 0), where Y £ (s), < 
s < T, satishes the SDE ()1.5|) and U is an arbitrary open set. In the linear 
approximation b{y,s) — A(s)y the variable Y £ (T) conditioned on 3^(0) = y is 
Gaussian with mean A(T)y and variance ecr 2 (T), where A(T), o- 2 (T) are given by 
the formulas, 



(5.1) 



A(T) = cxp 









/ A(s)ds 


, a 2 (T) = [ exp 


2 J A(s')ds' 


Jo 


Jo 





ds . 



The variable Y £ (T — 5) conditioned on Y £ (0) = y, Y £ (T) — 0, is also Gaussian with 
mean and variance given by the formulas 



E[Y e (T - S) | y e (0) = y, Y e (T) = 0] = 
(5.2) 

Var [Y £ (T - 6) | Y £ (0) = y, Y £ (T) = 0] - 



A(T - 8) 



y 



exp 



T-<5 



ea 2 (T - S) 
° 2 (T) 



exp 



T-S 



A(s')ds' 



A(s')ds' 



ds, 



ds. 



The mean in (|5.2|) is equal to y m in(T — 6) where y m i n (s), < s < T, is the unique 
minimizer for the functional J 7 [y(-)] of (|2.8p conditioned on y(0) = y, y{T) = 0. 
One easily sees from (|5.2j) that there are positive universal constants C\ , Ci such 
that 

(5-3) ^p- < E[Y e (T-S)\Y e (0)=y,Y E (T) = 0}<^-, 

deS < Var [Y e (T - S) \ Y £ {0) = y, Y £ (T) = 0] < C 2 eS, 

for y < provided 0<<5<T/2, AT < 1. It follows from ([P]) that there are 
positive universal constants C3, 73, C4, 74 such that 



p(y e (r-<$) < 

(5.4) 

p(y e (r-«j) > 



C 3 Sy 
T 

C 4 Sy 
T 



Y e (0)=y,Y e (T)=0) <exp 
Y e (0)=y,Y e (T)=0) <exp 



73<5y 2 



eT 2 
74 6y 2 



sT 2 



y < 

y < -Ty/I/S, 



provided < <5 < T/2, AT < 1. 

Evidently (|5.4p proves Theorem 1.2 in the case of b(y,-) linear in y £ R. We 
need to show therefore that (|5.4|l continues to hold for nonlinear &(•,•) satisfying 
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(jl.lj) and 6(0, •) = 0. Towards that goal we first observe that in the linear case there 
are positive universal constants C3, 73, C4, 74 such that if J-" m in = ^F[y-min(-)] then 

^[y(-)]-^m in > 73 Sy 2 /T 2 if y(T - 6) < C 3 Sy/T, 
^[y(-)]-^m in > 74 S y 2 /T 2 if y(T - 5) > C 4 Sy/T, 



(5.5) 



provided < S < T/2, AT < 1, y < 0. For nonlinear &(■,■) there is not necessarily 
a unique minimizer of the functional JF[y(-)] subject to y(0) — y < 0, y(T) = 0. 
Nevertheless, if .F m i n denotes now the minimum of .F[?/(-)] then (|5.5[) continues to 
hold. 

Lemma 5.1. Letb(-,-) satisfy 1 1.1]) and 6(0,-) = 0. Assume further that y < 0, <5 < 
T/2, ^4T < 1 and J- m i n is the minimum of the functional J-[y(-)] of \2.8]) subject 
to y(0) = y, y(T) = 0. Then H5.5\) holds for some positive universal constants 
C3,73,C4,74, on any path y(s),0 <s<T, satisfying y(0) = y,y(T) = 0. 

Proof. We first show that there are positive universal constants C\ , C2 such that 
(5.6) C lV 2 /T < JT min < C 2 y 2 /T. 

The upper bound in (|5.6p can be obtained by estimating for the linear 

path y(s) = (T — s)y/T, < s < T. To get the lower bound we consider a path 
y(s), < s < T, satisfying y(0) = y, y{T) = 0, and write 



(5.7) 



^. = b (y( s ),s)+f(s) = A( S )y(s) + f(s), 
ds 



where \A(s)\ < A, < s < T. Evidently we see from ([5 



V = 2/(0) 



exp 



A(s')ds' 



that 



f(s)ds. 



Since AT < 1 we conclude that 



< e / |/(s)|ds < eVT 



l/WI 2 ds 



1/2 



whence we obtain the lower bound in (|5.6p with C\ = l/2e 2 . 

To prove the first inequality in (|5.5p we consider for A > 1 a path y\(s), < s < 
T, satisfying y\(0) = y, y\{T) = and y\(T—8) = XSy/T. We derive a second path 
y* x from y x by setting y* x (s) = 0, T - 5 < s < T, y* x (s) = y x (s) - s\Sy/T(T - 6), 
< s < T — 6. Thus y^(-) is continuous and y^(0) = y, y\{T) — 0, whence we 
must have J-[y* x ( )] > J- m [ n . We also have that 



(5.8) 



•%a(0] = 



T-8 



dy' x (s) 
ds 



XSy 



T(T-5) 



- b(y* x (s) + sXSy /T(T-6),s) 



ds 



t r 



T-8 



-y^ - &(2/a(s),s) 
ds 



~] 2 



ds . 



Arguing as we did to get the lower bound in (|5.6p we see that 



(5.9) 



T-8 



dyx(s) 
ds 



~] 2 



ds > 



X 2 Sy 2 
2e 2 T 2 
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The first term on the RHS of (|5.8[) is bounded below by 



(5.10) ^K(.)] 2A ' % 



T(T - S) 



T-8 



(I 



ds 



ds, 



where we have used the fact that AT < 1. It follows then from (|5.9[) , (|5.10[) that 

(5.1D w)] > - 2 ^\nvi^ + 

Observe now from (|5.6[) , (|5.8[) , (|5.9[) that there is a universal constant C 3 such that 
if XS/T > C 3 then T[y x {-)] - T min > \ 2 Sy 2 /2e 2 T 2 . Suppose now that X5/T < 
C* 3 . If F[yl{-)] > [2C 2 + MCf\y 2 /T it follows from (l5TTll that T[y x {-)] - T min > 
\ 2 5y 2 /2e 2 T 2 . On the other hand if .%£(■)] < [2C 2 + 64Cf ]y 2 /T we see again from 
(|5~TTj) that --^min > \ 2 5y 2 /4e 2 T 2 if A > A > 1 for some universal A . We 

have proven the first inequality of (15. 5|) . 

We turn to the proof of the second inequality in ()5.5|) . Let yi(-) be a trajectory 
satisfying yi(0) — y, yi(T) — and set r = inf{s > : yi(s) = 0}. Suppose now 
that r < T — 8. From (|5.6|) one has that ^"[yi(-)] > Ciy 2 /r, and so the second 
inequality of (|53)l follows if r < CiT/2C 2 - We assume therefore that C{T j2C 2 < 
t < T — 5. Let ?/ m i n (-) be a minimizing path for the functional J r [y(-)] subject to 
the conditions y(0) = y, y(s) = 0, r < s < T. Then F[yi{-)\ > ^[?;min(-)]- From 
(|2.14| we see that there are positive universal constants C 3 , C4 such that 

(5.12) ^<%^-% min ( S ), S )<^, 0< S <r. 

1 ds 1 

Since AT < 1 we conclude from (|5.12[) that 

(5.13) eC 4 {T-s)y/T<y miD {s) < C 3 (t - s)y/eT, < s < r. 

It is clear that there is a positive universal constant Sq such that for < e < £0 
we may define a path y s (-) as follows: y £ {s) — y m in(s), < s < r — e<5; y e {s) — 
(T — s)y m - ln (T — eS)/(T — t + eS), r — eS < s < T. Since y £ {-) is continuous, 
y £ (0) = y, y £ (T) = 0, we have that F[y £ (-)] > T mia . From (|5TT2l) . (|5T^) we also 
have that 

(5.14) T[y m U-)] - nve(-)} > e8C 2 y 2 /2T 2 - e 2 C 2 e 2 Sy 2 /2(1 + e)T 2 , 

where we have used the fact that r < T — 6. Evidently the second inequality of 
(|5.5j) follows from (|5.14j) by choosing e = min[l, C 3 /2eC 4 ] 2 . 

To complete the proof of the second inequality of (|5.5[) we need to consider the 
case T - 5 < t < T. It is evident that if CSy/T < yi(T - 5) < for sufficiently 
small universal C > we may repeat the argument of the previous paragraph. 
Hence the result follows in all cases. □ 

We begin the proof of (|5.4p by sharpening the estimate (14.27)) on the Green's 
function G(y,x,t,T) defined by (fl~4) . 

Lemma 5.2. Suppose b(-, •) satisfies il.l)) and in addition 6(0, •) = 0. Then there 
are universal constants C, 5 > such that the Green's function G defined by 
satisfies the inequalities 



(5.15) G(2/,0,0,T)<-_exp 

V zirel 



1 CAT 



2eT(l + CAT) 
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(5.16) 



G(y,0,0,T)> 



1 



exp 



-y 2 (l + CAT) 
2eT 



CAT 



provided AT < 5. 



Proof. We shall first prove (|5.16[) . Suppose that we have shown that 
(5.17) 



G(y,0,t,T) > 



^/2ne(T - t) 



exp 



-y 



2e(T - t) 



{1 + CA(T -t)} -CA(T -t) 



for T — t = T/2 , where N is some integer N > 1. We shall show that for 
sufficiently large universal constant C > then (|5.17|) also holds for T—t = T/2 N ~ 1 . 
The inequality (|5.16[) will then follow by induction if we can prove (|5.17[) holds as 
T-t->0. 

Defining tpj by T — — T/2 N , N = 0, 1, 2, ... we see in a similar way to how we 
derived (j4~23"l) that 
(5.18) 



G(y,0,t N _ 1 ,T) 1 - a > I exp 

where F^(y, z) is given by the formula, 

A 2 (l-a) T 



2eT/2 N 



(5.19) F A r(y,z)=exp 



6ae 



2 N 



(y z + zy + z z )- 



F N (y,z)G(z,0,t N ,T) 1 - a dz, 
A 2 (1-a) T 2 



12a 2 2N 



Assuming now that we may bound G(z, 0, T) according to (|5.17p . then the RHS 
of (|5.18p becomes a Gaussian integral which we can evaluate. Taking a = AT/2 N 
in (|5.18p and Cjy to be the constant C in (|5.17p when t = t^, we see that it is 
possible to take Cn-i = 5Cjv/8 + 2 provided N > 1 and 5 < 1. We conclude 
therefore that 



(5.20) 



Co 



1G 
T 



1 



N' 



N 



c 



N, 



N > 1 



The inequality (|5. 16[) follows from (|5.20p if we can show that lim 5 n Cn/S> n = 0. 

We can do this by the same method we used to derive (|4.27[) . 

We shall show that the inequality (|5. 16[) holds with a constant C — C (AT) which 
can diverge as T — > 0, but in a mild in fact logarithmic way. As in (|4.23p we write 



(5.21) %0,0,T) 1 



> 



exp 



(y-zf 



2s(T — A) 



,1-B 



dz, 



.„ v /2tt£(T - A) 

F (y,z)G D< r 1 (z,0,T-A,TY 

where Gd,jj is the Dirichlet Green's function for the equation (|1.2p on the interval 
[-T], Tj], The function Fq is given by the formula (|5.19p when N — 0, and we take 
a = AT. As in Lemma 3.4 we use perturbation theory to estimate Go,,. In order 
for the perturbation expansion to converge we need that 

(5.22) rj = KVeA, (At]) 2 A = ve, 

where K » 1 and v « 1. In that case there is the lower bound 



(5.23) Gd,ti(z, 0, T — A, T) > 



1 



V / 27reA 



exp 



f-z 2 



\2eA 



d e 



-K 2 /4 
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-c 2 (p),v 2exp |___|j, N<7? , 

where C\ is a universal constant, p > can be arbitrary and C2G0) is a constant 
depending only on p. We shall substitute the RHS of (|5.23[) into (|5.21[) , choosing 
A/T, if and ^ to be powers of AT, in order to obtain a lower bound as in (|5.16p . 

Consider the situation when we approximate Gd,^ by the first term on the RHS 
of pK2"5J) . From ([5lHT) we have that 



(5.24) G(y,0,0,T) 1 ^ Q > inf 

l*l<»? 



Observe now that 



exp 



2e(T - A) 



1 



^27re(T-A) J_ 



r G A „(z,0,T- A,T)^ Q dz. 

J-r\ 



(5.25) 



exp 



z 2 (l-a) 



2eA 



> 



exp [-Ck AT\log(AT)\] , 



^f2ve{T - A) J-r, (2^A) (1 ~ q)/2 

1 

V2rcT 

for some universal constant C, provided we choose A/T = (AT) fc ° with fco > 1 and 
AT < 1/2. From (f5T25|) it is clear that it is sufficient to choose K = (AT)~ kl for 
any k\ > 0, whence (|5.21[) implies that v 1 / 2 — (AT) ko+1 ~ kl . If we now use the 
inequality 

2?7|y|/eT < (AT) k °/ 2 - kl [y 2 /eT+ l] , 
and choose k > 2fci + 2, we conclude from (|5.24|) , (|5.25)1 that (|5.16|) holds with C = 
C'\ log (AT) | for some universal constant C . We may easily extend this argument 
to apply to the actual lower bound (|5.23|) on Go,ri by using the inequality 

(5.26) max[a — 6,0] 1_Q >{a-b), a,b>0, a< 1. 

Returning now to (|5.20[) . it follows that we may take Cm = 0(N) whence liniAr^o 5 n Cn 
0. We have therefore show that (|5.16p holds for some universal constant C > pro- 
vided AT < 5 where 5 is also universal. 

To prove (|5.15[) we use a similar method as in the proof of the lower bound. 
Suppose we have shown that 
(5.27) 



G(y,0,t,T) < 



1 



V / 27re(T - t) 



exp 



-y 



2e(T-t)[l + CA(T-t)] 



+ CA(T - 1) 



for T— t = T/2 N where N is some integer N > 1. We shall show that for sufficiently 
large universal constant C > 0, the inequality (|5.27[) also holds for T — t = T/2 N ~ 1 . 
Analogously to (|5.18[) there is the inequality 



(5.28) G(y,0,t N - 1} T) 



l+a 



< 



1 



exp 



{y-zf 



2eT/2 



N 



, ^2keT/2 n 

F N (y,z)G(z,0,t Nl T) 1+a dz, 

where Tjv(y, z) is given by (|4.20|) with g = 0, x = 0, t — ijv-i and T is replaced by 
t n . Using the fact that one knows the pdf of sup W(s — t) we see that T/v(y, z) 

t<s<T 
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is bounded above by 
(5.29) F N (y,z)<exp 



A 2 {l + a) T 



3ae 



(y 2 + zy + z 2 ) + 



K A 2 (l + a) T 2 \ 
a 2 2N j 



for a universal constant Kq > 0, where we are assuming a = AT/2 N < S and 5 is a 
sufficiently small universal constant. Letting Cjv be the constant C in (|5.27|) when 
t = t j\[ , we see from (|5.28|) . ()5.29|) that it is possible to take Cn-i = 2(7^/3 + ^0+4, 
N > 1, provided AT < 5 and S is sufficiently small. Arguing as before then, in 
order to complete the proof of (|5.f 5[) we need to show that lim 2 N Cn /?> N = 0. 

To do this we show that (|5.15p holds with a constant C = C(AT) which can 
diverge as T — + but only in a logarithmic way. We use the inequality 



(5.30) G(y,0,0,T) 



l+a 



< 



exp 



{y-zf 

2e(T - A) 



Loo y/2ne{T - A) 

F o (y,z)G(z,0,T-A,T) 1+a dz, 

where F is given by the RHS of (|5.29[) when N = 0. 

Choosing 77, v as in (|5.22[) we see by perturbation theory that there is an upper 
bound 
(5.31) 



Gn, v {z,0,T-A,T) < 



V2neA 



exp 



2eA 



+ C 2 ( P y /2 exp 



2e(l + p)A 



i \z\<r), 



analogous to the lower bound (|5.23p . Suppose now that < z < rj/2. Then 

(5.32) G(z, 0, T - A, T) = G D , v (z, 0, T - A, T) + [ dt p(t) G D . v ( V /2, 0, t, T), 

Jt-a 

where p(t) is the density of the hitting time at rj/2 for paths of the diffusion Y £ (-) 
satisfying (|1.5p with Y e (T — A) — z, which exit the interval [0,77] through 77 before 
time T. Since \z\ < rj/2, it is evident that 

f T f v 

(5.33) / p(t)dt<l- G D .. n (z lZ ',T - A,T) dz' <C\e- K2/16 + C 2 v 1/2 , 

JT-A J-r) 

for universal constants C\ , C2 . One can also see from (|5.31|) on replacing T — A by 
t > T - A that 



(5.34) 



-x 2 /i6 ; T — A < t < T, 



V27reA 

for some universal constant C3. Substituting the RHS of (|5.33[) . (|5.34|) into the 
RHS of |532)) we conclude from (jOTj) that 



(5.35) G(z,0,T- A,T) < 



1 



V27reA 



exp 



2eA 



+ C 4 e- R2 / 16 



+ C 2 ( P y /2 exp 



2e(l + p)A 

We may estimate G(z, 0, T — A, T) similarly for \z\ > rj/2. Thus we have 



> \z\<v/2- 



(5.36) 



G(z,0,T- A,T) = f dt p(t)G(r)/2,0,t,T), z > V /2, 
Jt-a 
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where again p(-) is the hitting time density at rj/2. Evidently we have that 



(5.37) 



f P(t)dt = p( inf Y e (t) < rj/2 \Y e (T- A) 



It is easy to bound the RHS of (|5.37|) by using the inequality b(y, s) > —Ay, y > 0, 
in (|1.5[) and estimating the probability on the RHS of (|5.37D for the corresponding 
Gaussian process. Assuming that AA < 1/10 and z > 2r\ we have that 



(5.38) 



£ a P(*)A < F( o inf A jf e*W(.) < -,72^), 



where W(-) is Brownian motion. We may estimate the RHS of (|5.38p by using the 
fact that 



exp 



A / e As dW(s) — A 2 \e 2At — l] /AA 
Jo 



is a Martingale for any A € R. We conclude that 



(5.39) 



p(t)dt < exp - z 2 /16eA , z > 2-q 



T-A 



From (|5.35[) and (|5.39[) applied to (]5 .36[) we can see now that there is a universal 
constant C5 such that 

■v2 



(5.40) 



G(z, 0, T — A, T) < 



: exp 



2C 5 eA 



V27reA 

The estimates (|5.35p . (I5.40[) may be substituted into the RHS of (|5.30[) to obtain 
the inequality 



(5.41) G(y,0,0,T) 



l + Q 



< 



sup 

|2|<»j/2 



exp 



2e(T — A) 



Po(2/,2) 



p/2 

/ G(z,o,r-A,r) 



exp [-K 2 /C 6 ] 



-00 \/27r£(T - A) 



exp 



yJI'KE^T — A) J - 

(y-z) 2 1 



2e(T - A) 



C 6 



(l+")/2 



exp 



2C 6 eA 



dz, 



where C§ is a universal constant. The second term on the RHS of (|5.41[) is a 
Gaussian integral and so can be explicitly evaluated. To estimate the first term we 
use (|5.35l) and the inequality 

(a + b) 1+a < a 1+a + 2 a (l + a)a a b + 2 1+a b 1+a , a, b > 0, 

in the integration over the interval [—rj/2, rj/2]. One sees then from (|5.41[) that 
(I5.15P holds for a constant C — C"| log(j4T)| where C is universal. Hence as for 
the lower bound we may conclude that (|5. 15[) holds for some universal C provided 
AT < S with 5 > also universal. □ 

We can use the methodology of Lemma 5.2 to obtain similar estimates on 
G(y, £,0,T) for all £ £ R. To motivate the estimates we shall obtain, consider 
the linear case b(y, s) — A{s)y for which 



1 



exp 



2ea 2 {T) 



STOCHASTIC VARIATIONAL FORMULAS 



41 



where A(T),cr 2 (T) are as in (|5.1| . Observe now that 



y - £/ A(T) = y + 



/ T s)d.s - £ + 0[(AT) 2 }^. 
Jo 



It follows that provided AT < 1 there is a universal constant C > such that 

m n 2 



[y-C/A(T)] 2 < 



o 



(1 + CAT) + C(.4T) 3 £ 2 



Lemma 5.3. Suppose &(•, ■) satisfies and in addition &(0, ■) = 0. TTien i/iere 

are universal constants S,C > smc/i i/iai i/ie Green's function G defined by 
satisfies the inequalities, 
(5.42) 



G(y,Z,0,T)< 



(5.43) 

G(y,C,o,T)> 



1 



exp 



2eT(l + CAT) 



2eT 



CAT 



1 



V2^eT 
provided AT < 5. 



exp 



\y + f,T b(£, s)ds - a 2 CiATfi 2 
— — Jo ^ ' — (1 + CAT) - „ J, - CAT 



2eT 



2eT 



Proof. We proceed as in Lemma 5.2. To establish (|5.43j) we suppose we have already 
shown that 



(5.44) 
G(y,t,t,T)> 



y/2ne(T-t) 



exp 



{v + S;KZ,3)ds-& 

2e{T - 1) 

C[A(T - t)} 3 C 2 



2e(T - 1) 



{l + CA(T-t)} 
CA(T - t) 



for T — t = T/2 N , where N is some integer N > 1. Wc shall show that for 
sufficiently large constant C > then (|5"T4|) also holds for T — t = T/2 N ~ X . Using 
(|4.4|) with x — £ we may obtain an inequality analogous to (|5.18p . Thus on setting 
T-t N = T/2 N , N = 0,1, 2, it follows from g3J| that 



(5.45) G^Un-uT) 1 -" > 



y/2neT/2 



exp 



(y-z) 2 

2eT/2 N 



Fn{v,z) 



G\z + 



b(£, s)ds, £, iff, T 



dz, 



tN-l 



where similarly to (|5. 10|) one may take 

A 2 (l-a) T 



(5.46) - log F N (y,z) = 



3ae 



A 2 (l-a) 



ds 



b(£,s')ds'} + 



A 2 (l-a) T 2 
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We change the variable z of integration in (I5.45|) to z' where 



(5.47) 

From (|5.46|) we see that 
(5.48) - log F N (y,z) < 



f Kt, s)ds - t 



A 2 {\-a) T 



as 2 N 

12 



y- 



3A 2 (l-q) JT_ 



as 



2 N 



A 2 (l-a) T 2 
12a 2 2N 



Using the variable z' of (|5.47p and (|5.48|) we may argue as in Lemma 5.2 that (|5.44[) 
holds for t = t TV— i with constant Cn~i — 5(7^/8 + K for some universal constant 
K, where Cjv is the constant in (|5.44p when t = tpj. Thus we have established 



0. 



(|5.43p provided we can show that lim^v^oo 5 C 

As in Lemma 5.2 we shall complete the proof of (|5.43p by showing that it holds 
with a constant C — C(AT) which diverges logarithmically as T — > 0. To see this 
we observe as in (|5.45|) that 



(5.49) 
G(i/^ J 0,T) 1 - Q 



> 



1 



y/2ne(T - A) 
G 



exp 



{y + Jo T5 (£' s ) ds_ £~ z } 



21 



2e(T — A) 



+ j T A H^s)ds, e, T — A, 7^ 



where as in (|5.48p we may take F(y, z) to be given by 



(5.50) -logF(y,z) 



A 2 (l-a) 



T 



y+ / &(£, s )cfe-£ +z 2 



3A 2 (l-a) rj „ l9 A 2 (l-a) , 
i '- T[AT£] + — ( — -T 



ae 12a 
Let F(-, •) be the function defined from Then the function 

v(z,t) = G(z + F(£,t), t t, T), t<T, 
satisfies the terminal value problem 



(5.51) 
6(z-0 



dv 



+ [b(z + F(C,t),t)~b(F(^t),t)] — + 



dv e d 2 v 



2 dz 



t<T, z G R 



lim v{z, t), z G R. 



From (|5.5ip we see that we may proceed now exactly as in Lemma 5.2 by replacing 
the Green's function on the RHS of (|5.49p by the solution to (|5.5ip on the interval 
\z\ < rj with Dirichlet boundary conditions on \z\ = rj. Using the fact that 

\F(£, *)-{£- [ KZ, *)*>}] < C[A(T - t)] 2 \t\, 
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for some universal constant G, we conclude that the inequality (15.43|) holds. The 
proof of the upper bound (|5.42j) on the Green's function is obtained in a similar 
way, following the argument of Lemma 5.2. □ 

Corollary 5.1. Suppose 6(-, •) satisfies 11. 1^ and 6(0, •) = 0. Then there exist 
positive universal constants 77,63,73, 6*4,74 such that J5.^[ ) holds provided AT < r/ 
and 5 — T/2. 

Proof. To show the first inequality in (|5.4|) we consider 
P (n(T/2) < C 3 y/2 I y e (0) = y, Y e (T) = 0) 

= G(y, 0, 0, T)- 1 [° 3V/2 dt; G(y, £, 0, T/2) G(£, 0, T/2, T). 



It is easy to see now by using Lemma 5.2 how to bound G(y,0, 0,T) from below 
and G(£, 0, T/2, T) from above. Using also Lemma 5.3 to bound G{y, £, 0, T/2) from 
above, we conclude that the first inequality in (15. 4p holds for 8 = T/2 provided rj > 
is sufficiently small. To show the second inequality of (15. 4|) we write 



P (y c (T/2) > G 4 y/2 I F £ (0) = y, y e (T) = 0) 

= G(y, 0, 0, T)- 1 / G(y, £, 0, T/2) G(C, 0, T/2, T), 

Jd y/2 

and argue as in the previous paragraph. □ 

In order to show that (15. 4|) continues to hold when 5/T << 1/2 we need to obtain 
some further estimates on Green's functions. Towards that goal we strengthen 
Corollary 5.1 as follows: 

Lemma 5.4. Suppose &(•, •) satisfies and 6(0, •) = 0. Then there exist positive 

universal constants r\, C\, Ci such that if AT < r\, 

(5.52) P ( sup \Y e (s)\ > p I Y £ (Q) = y, Y £ (T) =o]< cxp [-C lP 2 /2eT] , 

\0<s<T I 



provided \p\ > G2 



Ivl + v^T 



Proof. We do a dyadic decomposition of the interval < s < T. Thus let S n ,n = 
0, 1, 2, be defined by S n = {jT/2 n : < j < 2"}. It is evident from the continuity 
of Y e (-) that 

(5.53) P ( sup |y e (s)| > p I Y £ (0) = y, Y £ (T) = o] < 

\0<s<T / 

00 / 

VP( sup \Y £ (s)\> p(l-p n+1 ), sup \Y £ (s)\ < p(l-p n ) j Y £ (0) = y, Y £ (T) = 

provided p E (0, 1) satisfies p(l — p) > |y|. Observe next that 
(5.54) 

P ( sup |Y e (s)| > p(l - p n+1 ), sup |y £ (s)| < p(l - p n ) I Y £ (0) = y, y e (T) 
\_sgs„-s„_i ses„_i 

< P - y e (s + T/2 m )\ > pp, n (l - p) I y e (0) = y, y e (T) = 0) . 
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The probability in the sum on the RHS of (15.54| can be expressed in terms of the 
Green's function (11.41) as follows: 



(5.55) P(\Y s (s)-Y e (s+T/2 n )\> pp n (l-p) \ Y e (Q) = y,Y e (T) = 0) = 



G(y,0,0,T)- 



OO />OC 



OO J — OO 



d£d( G(y, £, 0, s)H (|£ - CI - - M)) 

G(£, C, s, s + T/2") G(C, 0, s + T/2", T), 



where H(z), z € R, is the Heaviside function. We may estimate the integral on the 
RHS of (|5.55|) by using Lemma 5.2 and Lemma 5.3. We first consider the integral 
with respect to £- in (|5.55p for a fixed £ € R. From Lemma 5.3 we have that 



(5.56) 

G(y,t,0,s) G(ZX,s,s+T/2 n ) < 



: exp 



2es 



-' " KC,/)^WT (1 _^ T/2 „ )+ g(^) ; ^ 



2es ' 2eT/2™ 
Setting z = y + J* b((, s')ds' - ( we see from f|5.56[) that 

(5.57) G(y,Z,Q,s) G(£, s, s + T/2") < 



2eT/2 n 



1 



2irs^sT/2 n 



exp 



{z 2 + 2(C-£)z + (C-£) 2 } (C-6 2 C4 



2es 



2.-7,2" , — [(C-£) 2 + ^ 2 + C 2 ]+GAT 



for some universal constant C. Integrating the RHS of (|5.57p over the region |£— C| > 
pp n (l — fi) we conclude that 

/OO 
d£ G(y, £, 0, s) H (|£ - C| - PM n (l - /*)) G(£, C, «, « + T/2") < 
-OO 

p 2 p 2n {l ~ p) 2 



exp 



4eT/2™ 



: exp 



2et„ 



1 2CAT~\ CA 

2 ~J + ~T~ 



{z 2 + C 2 } +GAT 



where r„ = T/2" + s/2 - 2CAsT/2 n . Hence if we use the inequalities 

(y - C) 2 [l - As] - As( 2 <z 2 <(y- C) 2 [l + As] + 2As( 2 , 

which are valid for AT < 1, and substitute the RHS of ([535)1 into the RHS of 
(|5.55p . we may conclude from Lemma 5.2 that the LHS of (|5.55[) is bounded by a 
Gaussian integral in C- Evaluating this integral we have then that 



(5.59) P (\Y e (s) ~Y e (s + T/2") | > pp n (l - p) | Y £ (0) = y, Y e (T) = 0) < 



G(y,0,0,T)- 1 



[2 7 re(T + T/2")] 1 /2 



exp 



pV"(i-m) 



GAy 2 



4eT/2" 2e(T + T/2") e 

for some universal constant G. Choosing now in (15.59(1 to satisfy 1/V2 < p < 1 
and using the lower bound for G(y, 0, 0, T) in Lemma 5.2 we conclude from (|5.59p 
that 

(5.60) P (\Y £ (s) - Y £ (s + T/2") | > pp n {l - p) \ Y s (0) = y, Y £ (T) = 0) < 

-p 2 p 2 {\- p) 2n ^ 



CAT 



exp 



SeT/2 n 



if p>C 2 [\y\ + VeT], 
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provided C2 is a sufficiently large universal constant. Hence (15.53| . (15.541) imply 
that 



(5.61) P[ sup \Y £ (s)\ >p \Y e (p)=y, Y e (T) = 0) < 

\0<s<T 



exp 



pV"(i-m) 

8eT/2 n 



< exp 



2eT 



for some universal constant Ci > 0. 



□ 



To prove (|5 .4[) under the assumptions (|1.4p and 6(0, •) = we actually need 
versions of Lemma 5.3 and Lemma 5.4 which hold in the situation when 6(0, •) ^ 0. 
A slight modification of the proof of Lemma 5.3 yields: 

Corollary 5.2. Suppose &(•,•) satisfies (1. 1\) . Then there are universal constants 
rj, C > such that the Green's function G defined by satisfies the inequalities 
(5.62) 



G(y,£,o,r) < 



1 



exp 



2eT(l + CAT) 2eT e 



(5.63) G(y,£,0,T)> 



1 



exp 



{2/ + fn &(£, S)rfs - CI 2 

2eT 1 y 



2eT e 



\b(0,s)\ds 



provided AT < rj. 

We can also slightly modify the proof of Lemma 5.4 to obtain the following: 
Corollary 5.3. Suppose b(-, •) satisfies (Op . Then for any y 6 R which satisfies 



(5.64) |y| 
i6e result of Lemma 5.4 holds. 



eT> 



\b(0,s)\ds. 



Proof. We simply use the Green's functions bounds of Corollary 5.2 in place of the 
bounds of Lemma 5.3 in the argument of Lemma 5.4. □ 

Lemma 5.5. Suppose 6(-, •) satisfies il.l]) and 6(0, •) = 0. For AsR define b\(-, ■) 
by b\(y, s) = b(y + As, s), y € R, < s < T, and let G\ be the Green's function 
associated with b\. Then there are universal constants n,C > such that the 
following inequalities hold provided AT < rj: 



(5.65) 
(5.66) 



G A (y,0,0,r) 
G o (y,0,0,T) 

G A (y,0,0,r) 
G? (»,0,0,T) 



< exp 



> exp 



C|A|AT 



{M + |A|^T 2 }+CMT 



C\X\AT 



{\y\ + \\\AT 2 }~CAT 
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Proof. Consider first the situation when \y\ < |A|AT 2 . The result follows from 



Corollary 5.2 on using the inequality \b\(0, s)\ds < \X\AT 2 /2, whence we need 
only prove (f5T65|) . ([5T66]l for \y\ > |A|AT 2 . Observe now that if \y\ = 0{VeT~ ) then 
\X\AT\y\/e = 0(y 2 /eT) = 0(1). Hence we might expect to prove ff5T65]) . 
for \y\ = (9(V ' sT ) by perturbation methods. To implement this we consider the 
function u x (z,t), z£R, t <T, defined by 

(5.67) u x (z, t) = G x [z- [ b x (0, s)ds, 0, t, T ) . 



Evidently u x is a solution to the terminal value problem 

(5.68) — + b x (z,t)— + - = 0, zeR,i<r, 

lim u\{z 1 1) — 8{z), 

where b\{z, t) is given by the formula 

(5.69) b x (z, t) = b x (z- jf 6 A (0, s) da, tj - 6 A (0, f). 

Following the argument of Lemma 3.4 we see that the terminal value problem 
(I5.68|) on the interval \z\ < r\ with Dirichlet boundary conditions can be solved by 
perturbation expansion for times < t < T provided sup{|6>(2;, t)\ : \z\ < rj, < 
t < T}(T '/ e) 1 / 2 << 1. Assuming now that y, r\ satisfy the inequalities 

(5.70) \X\AT 2 < \y\ < VFr/{AT) 6 , tj = v7f/{AT) 2S , 

it is clear that the perturbation expansion converges provided 6 < 1/2 and AT 
is smaller than some constant depending only on 5. In fact, letting G(z,t),z € 
R, t > 0, be the probability density function for the normal variable with mean 
and variance t we have that 

(5.71) 

u x (z,t)-G(z iS (T-t))+J ds J"' dSG(z-S,e(8-t))b x (Z,8)-j^G(Z,e(T-8)) 

< C{AT) 2 - 4S G(z, 2e(T-t)), 

provided \z\ < y/sT j (AT) S . Here AT needs to be smaller than some constant 
depending only on 6, and the constant C on the RHS of (|5.7ip also depends on 6. 
It is easy to see that 



(5.72) | J dt; G(z - e, e(s - t)) b x fo a) ^ G(£, e(T - a)) 

i r°° A 

<-J d£G(z- C, e(s t))^—^ + A 2 A 2 T 2 (T - s ) 2 ] e(T - a)) 

~ ^{4!^^ + 3^ + 3^)J G(2e(r _ t)) 

Substituting the inequality ()5.72|) into (|5.71|) we conclude that u\(z,t) satisfies the 
inequalities 

(5.73) u x (z, t) < G(z, e(T - *)) + C{AT) 2 ~ 4S G(z, 2e{T - t))+ 



STOCHASTIC VARIATIONAL FORMULAS 



47 



A 3 X 2 T 2 {T-t) 2 
Te 



+ 



3A(T - 1) 



4c 



(5.74) 



u\{z, t) > G(z, e{T - t)) - C(AT) 2 ^ S G(z, 2e(T - t))- 
A 3 X 2 T 2 {T - t) 2 3Az 2 3A(T - t) 



■is 



4c 



G(z,e(T-t)), 



G(z,e{T-t)). 



We have shown that (|5.73p . (|5.74|) holds for the function u\(z, t) which satisfies 
(|5.68jl on the intervals \z\ < r\, < t < T, and with Dirichlet boundary conditions 
on \z\ = r\. It follows that the function u\(z,t) defined by (|5.67p . also satisfies 
(|577i| for \z\ < \f£T/(AT) 5 , < t < T. From the argument of Lemma 5.2 we 
see that the upper bound (|5.73|) continues to hold for the function (|5.67|) when 
\z\ < V^T/(AT) S . 

The inequalities (|5.65[> . (|5.66[) can be deduced from (|5.73|) . (|5.74|) in the case 
when y lies in the interval |A|/1T 2 < \y\ < K«JsT, where K > 1 is a constant. The 
constant C now in (|5.65|) . (|5 . 66[) depends on K, and AT must be chosen sufficiently 
small depending only on K. To obtain the lower bound (j5.66|) we set 6=1/8 and 
z = y + Jq T 6a (0, s)ds, t = in (|5.74[) . Thus we obtain the inequality 
(5.75) 



G x (y,0,0,T)>G [y- 



b\(0, s) ds, eT exp 



-C 



\ 2 {ATfT 



AT e K * 



for some universal constant C. Lemma 5.2 implies that Go(y, 0, 0, T) satisfies the 
upper bound 



(5.76) 



G (2/,0,0,T)<G(y,eT)exp CAT{1 + K 2 ) 



for some universal constant C . Now (|5.66[) follows by estimating from below the 
ratio of the RHS of (I5.75|) to (|5.76|) . The upper bound (|5.65p can be similarly 
obtained from (|5.73|) and Lemma 5.2. 

To complete the proof of the lemma we use induction as we did in Lemma 5.2. 
We consider the lower bound (|5.66p . Observe first that the previous arguments 
imply that the lower bound 



(5.77) 



G x (y,0,t,T) 



> exp 



-C\X\AT 



{\y\ + \X\AT(T-t)}-CA(T-t) 



G (y,0,t,T) 

holds for < t < T if y lies in one of the regions \y\ < \X\AT(T-t) or \X\AT(T-t) < 
\y\ < KyJe(T — t). For the former region the constant C in (|5.77|> can be chosen in 
a universal way provided AT is smaller than some universal constant. For the latter 
region C depends on K and AT, and must be taken sufficiently small depending 
only on K. 

Suppose now we have proved (|5.77p for T — t = T/2 N , y S R, where N is 
some integer N > 1 with constant C = Cjv- We show that (|5.77p also holds for 
T — t = T/2 N ~ 1 , y £ R, with a constant Cjv-i given in terms of Cjv- To do this 
we use the inequality 



> 



(5.78) Ga^O,^!^) 1 -" 

f- CO 

/ G (y, z,t N -i,tjy)exp 



(1-a) A 2 X 2 T 3 



2ae 



Ga (^O,^,^) 1 



dz, 
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where T-t n = T/2 n , n = 0, 1, 2..., < a < 1. The inequality ([578]) is derived 
similarly to (|5.18|) . 

We assume y in (I5J8]) satisfies |y| > max \X\AT(T - tjy-i), K^s(T - t N ) and 

set a = |A| J 4T 2 /|y|2 JV < 1/2. Then, on substituting (pT7?|) for t = t N into (|5TT5j) 
we obtain the inequality 



(5.79) GMt»-^)]- a > 



exp 



Go(y,0,t JV _i,T)i-« 
(1 - a)|A|i4T|y| -Cjv(1 - a)|A| 2 (AT) 2 T CW(1 - a)AT 



2t 



£ G o (y £ (^),0,^,T)- a exp 



C N (l-a)\X\AT\Y £ (t N )[ 



G (y,0,tN-i,T) a 



n(to-i) = y, r e (T) = 



where Y s (-) is the solution to (|1.5p . From Lemma 5.2 we have that 

,,2 



(5 ' 80) Go(z,o,^r) ^ exp 



2 g 2eT/2^ 2^ 



z e R, 



for some universal constant C . Since we are assuming that \y\ > KyJe{T-t N ), 
we conclude from (|5 . 80[) that for sufficiently large K, 



(5.81) 



G o (y,0,t N ^,TY 



> 



exp 



\MAT\y\ 



zeR. 



G (z,0,t N ,T)<* 

To get a lower bound for the RHS of (|5.79[) we are therefore left to estimate from 
below the expectation 



(5.82) E \ exp 



C N (l-a)\X\AT\\Y £ (t N )\ 



Y s (tN-i)=V, Y £ (T)=0 



> exp 



C N (l-a)\X\AT 



E 



[\Y £ (t N )\ | Y s (t N _i) = y, Y £ (T) = o} 



We estimate the expectation on the RHS of (|5.82p by 

(5.83) E [\Y £ (t N )\ | Y e {ttf-i) = V, Y £ (T) = 0] < 

Oil POO 

-f- + dpP[\Y £ (t N )\-y/2\>p Y £ (t N -i) = y,Y £ (T) = 

4 J\y\/i V 

We have now that 

(5.84) P (\Y £ (t N ) - y/2\ > p \ Y £ (tjv-i) = y, Y £ (T) = 0) 

/"CO 

= G(y,Q 1 t N _ ll T)- 1 / d^G(y,^t N ^,t N ) H(\£-y/2\-p) G(£,0,t N ,T) 



with H(-) being the Heaviside function. Now, arguing in the same way as we did 
to obtain (|5.60p we conclude from (|5.84[) that 

(5.85) P (\Y £ (t N ) - y/2\ > p \ Y £ (t N -i) = y, Y £ (T) = 0) < 

r P 2 CAy 2 
6XP [-2lfW + ^ 
where C and Kg are universal constants. Hence we have that 



if p>K y/e(T-t N ), 
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/•oo 

(5.86) / dp P (\Y 5 (t N ) - y/2\ > p \ Y e (t N -i) = y, Y E (T) = 0) 
■%l/4 



< 



eT 



■ exp 



)JV-4 



CAy 2 



2eT 



\y\2"~ 2 

provided the constant K in (|5T85|) satisfies K > AK Q . Now (f5T83|) and ([5T86]) 
imply that the expectation on the LHS of (|5.83f> is bounded by 4|y|/5. Hence 
it follows from ([5T9"]) . (|5T8"T]) . (gjgg) , that we can take Cjv-i = 4CV/5 + ifi for 
some universal constant K\ . Thus in order to complete the proof of (|5.66[) we need 
to show that Cm satisfies limAr_^ 00 4 JV Cn/5 n = 0. To do this we proceed as in 
Lemma 5.2 by proving that (|5.66|) holds with a constant C = C(AT) which diverges 
logarithmically in AT as AT — > 0. 

We have already observed that (|5.66p holds for a universal constant C if \y\ < 
\X\AT 2 and for a constant C depending only on K if |A|AT 2 < \y\ < KVsT. Hence 

we shall assume that \y\ > max \X\AT 2 , K^/eT . Analogously to (|5 . T8[) there is 
the inequality 



(5.87) G x (y,0,0,T) 



l-a 



> 



G (y,z,0,T- A) exp 



(1 



2ae 



A 2 X i T i 



G x (z,0,T- A,T)^ a dz. 



We set a = \X\AT 2 /2\y\ in 1)5.87|) . whence < a < 1/2 and the exponential on the 
RHS of (|5T87jl can be absorbed into the RHS of ([5T66]) . As in (|5T67]) we shall obtain 
a perturbation expansion of G\ (z, 0, T — A, T) by considering the function, 

(5.88) u x (z,t) = G x (z + ipx(t),0,t,T), where 

4>' x {t) = b x (<px(t),t), t<T, vx(T) = 0. 

Then u x (z, t) is a solution to the terminal value problem (|5.68p but now with drift 
bx(z,t) given by 

(5.89) b x (z, t) = b x {z + Vx (t), t) - b x {<px{t), t). 

Since | 6a £)| < A\z\, z € R, we may expand the solution of the Dirichlct problem 
(I5.68P by perturbation theory on the intervals |z|<?7, T — A < t < T, provided 
i], A satisfy 



(5.90) 



rj = K 1 \feK, {Ar)) 2 A = ve, 



where K\ >> 1 and v << 1. Thus if u x ,d(z, t) denotes the solution to this Dirichlct 
problem we have as in (|5.23[) the inequality 



(5.91) uxM^T~A)> 



C3 exp 



1 



v / 27reA 
- Kl 
4 



exp {^} _ 

-C A {p)v 1/2 exp 



\z\ < 1], 



2e(l + p)A 

where C3 is a universal constant, p > can be arbitrary and Ci(p) is a constant 
depending only on p. We choose now v, K\ , A /T by 

(5.92) K x = (AT)- kl exp[C 1 Ay 2 /e], v 1 ' 2 = {AT) k ' 2 exp[-C 2 Ay 2 /e], 
A/T = (AT) k ^- 1 exp[-(C 1 +C 2 )Ay 2 /e] , 
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where k%, fe, Ci, C2 > and k\ + > 1. Evidently the choice of K\,v,A in ()5.92j) 
is consistent with (|5.90p . 

To estimate from below the LHS of (|5.66|) we use the inequality derived from 
(15^71) . fQ8jl . 

(5.93) C A (y,0,O t r)^> CT p [- Il^M^ 

G o (y,z,0,T-A)ux, D (z-cp x (T-A), T - A) Q dz. 

-»)+ V a(T-A) 

If we substitute now the RHS of (|5.91|) into the RHS of (|5.93|) we obtain an integral 
which we would like to show is comparable to Go(y, 0, 0, T) 1- ". To do this we write 



(5.94) 



/OO 
G (y, z,0,T- A) G (z, 0, T - A, T) dz, 
-00 



and use perturbation analysis to show that Gq(z, 0, T — A, T) is comparable to the 
RHS of ((5Ji]) . Using the upper bound (jOS) on G (z,0,T - A, T) in (f5T94|) we 
obtain an upper bound on Go(y, 0, 0, T) which has the same form as the integral 
on the RHS of (ET931) . 

We compare the principal terms of these integrals. Thus for the integral on the 
RHS of (|5.93p the principal term is 
(5.95) 



(2tteA) 



v/2 



r,+ Vx (T~A) , 

G {y,z,Q,T-A)-=== 

-ri+tpx(T-A) Vine A 



exp 



-(1-a) 



{z~ Vx (T-A)Y 
2eA 



dz. 



For the integral on the RHS of (|5.94|) the principal term is 



(5.96) 



Go(y, z,0,T — A) 



1 



V2neA 



exp 



2eA 



dz. 



Observe now that we may assume \<p\(T — A)\ < rj/2. To see this we first note 
from (|5.88p that \(fi\{T — A)| < CM|A|TA for some universal constant C, whence 
it follows that \(p x (T - A)\ < C\y\A/T. Thus from (|5J0| the inequality will follow 
if we can show that 2C\y\ < K\(T / A) 1 ! 2 \/eT, which is equivalent to showing that 
4C 2 \y\ 2 /eT < K 2 (T/ A). Choosing K x , T/A as in (j5~M)) we see that this inequality 
holds provided 3fci + /c2 > 2 and AT is sufficiently small, depending only on C\, C2. 
Similarly we have that 

(5.97) ^a(T-A) 2 | r,\tp x {T-A)\ < C 2 A 2 \X\ 2 T 2 A | C V A\\\T < 



2eA 



•A 



2e 



2e + 



1/2 



T ) ~ 2e 



provided the constants in (|5.92|) satisfy &2 > &i + 5, C% > C\. In that case the 
constant C in (|5.97|) depends only on k\ , &2 , C\ , C%. We conclude then that the 
expression in (|5.95[) is bounded below by 
(5.98) 



(27reA) Q / 2 exp 



C|A| 2 A 2 T 3 



CAT 



/ G (2/,z,0,T-A)-==exp 
J-n/2 V27reA 



2eA 



dz. 



for a constant C depending only on the constants in (|5.92[) 
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Next we bound the integral in (I5.98|) from below by a constant times the integral 
in (I5.96|) . To show this we use Lemma 5.3. Thus the Green's function Go(y, z, 0, t) 
is bounded above and below by the inequalities 



(5.99) G (y,z,Q,t) < 
G o (y,z,0,t) > 



1 



\/2net 
1 



\/2net 



exp 
exp 



(y - z) 2 CA , , 9n „ ' 

■ ' + — (y 2 + z 2 ) + CAt 

let e 



jy-zf 

2et 



CA 



(y 2 + z 2 )- CM 



Substituting the lower bound of (|5.99|) into (|5.96p we conclude that 



(5.100) f G (y, z,0,T- A) -7== exp 
J-oo V2ireA 



2eA 



1 



: exp 



dz > 



-^-^y 2 -CAT 
2eT e y 



for some universal constant C. Using the upper bound in (|5.99|) we also have that 

./2 



(5.101) / G o (y,z,0,T-A) -=L=exp 
J\z\>v/2 v2-KeA 



'\*\>v/ 
< exp 



2eA 



dz 



16eA 



< 



f G (y,z,0,T - A) —L=exp 
J-oo V27reA 



4eA 



dz 



1 



: exp 



+ y 2 + C AT+ 1 -lo g 2 



y/2-rreT 

for some universal constant C. Observe that in (|5.101[) we are assuming that the 
constants in (|5.92|) satisfy k\ + &2 > 2 so that A/T < AT. Now taking r\ to be 
given by ([530]) . f5^) . we conclude from (|5.100j) . (|5.10ip that 



(5.102) f G (y,z,0,T-A) -=L=exp 
J\z\> v /2 V27reA 



l\z\> n /2 

< exp 



2eA 



dz 



32{AT) 2k 

It follows that (|5.95p is bounded below by 

c'a| 2 A 2 T 3 



( G (y, z,0,T- A) — =^= exp 
J-oo \/2-keA 



2sA 



dz. 



(5.103) (271-eA)"/ 2 exp 



1 — exp 



1 



32 (AT) 



CAT 



Go(y, z,0,T — A) 



1 



: exp 



2eA 



dz. 



V2neA 

The integral in (|5.103p is the principle term in the expression (|5.94|) for Go(y, 0, 0, T). 
Assuming then that we can replace the integral by Go(y, 0, 0, T) and that we take 
into account only the principal term for ua,_d in (|5.93[) . we have from (|5. 103[) that 
the inequality 



(5.104) G A (y,0,0,T) ] 



> 



(27TEA) 1 / 2 G (y,0,0,T) 



exp 



(7(1 - a)\X\AT 



{\y\ + XAT 2 } - C(l — a)AT 



G (y,0,0,TY 
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holds for some universal constant C. By Lemma 5.2 we have that 
(5.105) 

O^eA) 1 / 2 G o (y,0,0,T) 



> 



exp 



f log(T/A) - ^ (1 + CAT) - aCAT 



for some universal constant C. Taking a as before to be given by a = \X\AT 2 /2\y\ < 
1/2 and using the fact that \y\ > K\/eT we see from (15321) . (|5.105p that 
(5.106) 



(2 7 reA) 1 /2 G (i/,0,0,T) 



> exp 



-(1 - a)CAT 



|Ay| 



log(AT)| + l 



where the constant C depends only on the constants C\ , C 2 , k\ , &2 of (|5.92p and 
also K. Combining then (|5.104p . (|5. 106|) we have obtained a lower bound of the 
form ([5361) with a constant C = C{AT) = C'\ log(AT)|. 

To complete the proof of (f5T66|) with a constant C = C(AT) = C'\ \og(AT)\ we 
need to estimate the effect of the error terms in (|5.35l) . (15.91[) . From (|5.35[) the 
main error term in (|5.94p is given by 



(5.107) 



G (y,z,0,T-A) C 2 {p)v x l % 



exp 



2e(l + p)A 



dz, 



V2tt£A 

where v is given by (|5.92p . It is evident that by choosing k 2 , C 2 sufficiently large 
in a universal way in (|5.92p that the integral of (|5.107p is bounded above by AT 
times the integral on the LHS of (|5. 100f> . We can similarly estimate the error terms 
in (|5.93p of u\,d- If we use the inequality (|5.26p then from (|5.9ip we obtain a term 
like ([BTTOTjl . Hence (f^66|) with a constant C = C{AT) = C'\ log(AT)| holds. By 
previous argument it follows then that (|5 . 66[) holds with some universal constant 
C provided AT < rj, where r\ may also be chosen in a universal way. 

The completion of the proof of the upper bound (|5.65|) can be carried out in a 
similar way to the method we used to prove the lower bound. □ 

Lemma 5.6. Suppose &(•, •) satisfies and 6(0,-) = 0. If G is the Green's 

function defined by [1.4\ ), then there are universal constants n, C > such that G 
satisfies the inequalities, 



G(y,0,0,TJ 



2eT v ' eT l 



CAT sgn(^)] + CAT 



(5-109) SM4S>eM> 



~2^f {1 + CAT) + CAT Sgn( ^ )] " CAT 



G{y, 0, 0, T) 
for all y, £ G R, provided AT < rj. 

Proof. The result follows from Lemma 5.3 if \y\ < |£|, so we shall assume that 
|£| < \y\. Letting w(z,t) = G(z,£,t,T), t < T, it follows from (T2J that the 
function w\(z,t) defined by 

A 2 , 1 
(T-t) 



(5.110) 



wa(^.*) = exp 



"T + 2e 

is the solution to the terminal value problem 



(5.111) 



o = ^ + b{z + X t,t) dwx 



dt 



w(z + \t, t) 



e d 2 w\ A 

H — b{z + At, t)w\, 



dz 2 dz 2 
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lim w\(z, t) 



t->T 



exp 



Xz 

e 



5{z + \T-£), 



Taking A = £/T in (|5.111[) we see from Lemma 5.5 that 
(5.112) 

i-T 



w x (y,0) = G x (y,0,0,T)E 







exp < 









b(Y £ , x (s) + As, s) ds} Y £ , x (0) = y, Y eX (T) 



where Y eX (-) is the solution to (|1.4[) with the drift b x of Lemma 5.5 in place of b. 
Since 

|6a(0, s)| ds < AT 2 \\\/2 < |e| < \y\ 

if AT < 2, we can use Corollary 5.3 to estimate the expectation in (|5.112[) . To see 

this first observe that the expectation is bounded above by 

(5.113) 

~\ 2 AT 2 ~\ „ r ( AT\X\ 



exp 



2e 



E 



exp 



V 



sup \Y e , x {s)\ } y e , A (o) = y, F E)A (T) = 

^ 0<s<T 



To bound the expectation in (|5.113p we use the identity, 



(5.114) 



E 



1 



E 



Xe 



kX 



dk 



for any random variable X. From (|5.52ll we have that 



(5.115) E 



sup |y £ , A ( S )|exp^r sup \Y £ . x {s)\\ Y e>A (0) = y, Y e>x (T) = 

0<s<T 



< Co 



0<s<T 

ef 



OO s 

(n + 1) exp < nrC2 



n=0 



exp 
2/1 + VeT 



[rC 2 [\y\ + V^T 



} 



/2eT , 



for any r > 0. Assuming r < AT|A|/e and using the fact that |A| < \y\/T, we 
see that there is an integer no > 1, depending only on AT and C\, C*2, such that 
2r < CiC2?t.o[|?/| + V~eT]/2eT. Hence (|5.115j) implies that there is a constant C 
depending only on AT such that 



(5.116) E 



It follow now from 1|5.116|) . on using the inequality 2\/eT < e/\X\ + |A|T, that there 
is a constant C depending only on AT such that 



sup \Y etX {a)\ exp ^ r sup |Y e , A (s)| \ Y £>x (0) = y, Y £ . X {T) = 

0<s<T I 0<s<T J 

< C* \y\+VsT cxpjcY |y| + VeT |, < r < AT\X\/e . 



(5.117) E 







exp < 






[e Jo 



b(Y e , x (s) + As, a) da | F e , A (0) = y,F £ , A (T) = 
'C|A|AT r 



< exp 



|A|T} 



CAT 



Substituting (|5.117p into (|5.112| and using inequality (|5.65j) of Lemma 5.5, we con- 
clude that upper bound (|5.108p holds. The lower bound (|5.109|) can be established 
by a similar argument. □ 
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Proof of Theorem 1.2. Since in Corollary 5.1 we already proved the result for 5 ~ 
T/2 we shall be concerned here with the situation where S/T << 1. We have now 
with y < 0, the identity 

(5.118) P (Y e (T -S)< C 3 Sy/T | Y e (0) = y, Y e (T) = o) = 

pCsSy/T 

G{y, 0, 0, T)- 1 / d£ G(y, £, 0,T - <5) G(£, 0, T - 5, T). 

There is also the identity, 

/OO 
d£ G(y,e,0,T-5) G(£,0,T - S,T). 
OO 

From Lemma 5.2 and Lemma 5.6 one obtains from (|5. 119|) the inequality, 



(5.120) G(y,0,0,T)> 



G(y,0,0,T-S) 



V2irs6 



d£ exp 



2e{T - 8) 
CM 3 CA\£y\ 



CAT 



2e5 e{T~8) e e 

for some universal constant C . Now let X be the normal variable with mean 5y/T 
and variance eS(T — S)/T. Then (|5. 120|) is equivalent to 
(5.121) 



G(y,0,0,T)>G(y,0,0,T-6) 



T-S 
T 



1/2 



exp 



Sy 2 



2eT{T - 5) 



CAT 



E 



exp 



-CAX 2 CA\y\\X\ 



Applying Jensen's inequality in (|5.121[) and then the Schwarz inequality we con- 
clude that 
(5.122) 



G(y,0,0,T)>G(y,0,0,T-S) 



T-S 
T 



1/2 



exp 



5y 2 



2eT(T-5) 



CAT _CA^_ CA f: 
eT 



1/2 



for some universal constant C . We similarly have from Lemma 5.2 and Lemma 5.6 
that 



(5.123) 



C 3 Sy/T 



'T - S\ 1/2 
G(y,0,0,T-a)(-^-J exp 



clU GfatAT-S) G(£,0,T - 6,T) < 
Sy 2 



2eT(T - 5) 



-CAT 



E 



{ CAX 2 CA\y\\X\ 

exp <^ 1 

I £ e 



X < 



C 3 Sy 



T 



for some universal constant C. Assuming now that C 3 > 1, we have then 



(5.124) E 



ex (CA^ + GA M X 1 

{ £ £ 



X < 



C 3 Sy 
T 



< /5 r (c 3 - 1) 2 ^ 2 

< V2exp ; - 

* [ AeT{T-5) 

{CAX 2 CA\y\X! 



E 



(CAX? CAMXt 
' XP | — + el +eXP l 



where X\ is the Gaussian variable with mean Sy/T and variance 2eS(T — S)/T . The 
expectation on the RHS of (|5.124[) can be explicitly computed. Hence we conclude 
that 



(5.125) E 



{ CAX 2 CA\y\\X\ \ Y ^C 3 5y 

ex n^ + ^^- \ ;X< — 



< 
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2V2 



exp 



(C 3 -l) 2 <% 2 , CASy 2 



AeT(T -5) eT 



CAS 



for some universal constant C. The first inequality of (|5.4[) follows from (|5.118p 
(|5.125p upon taking C3 large enough and using the fact that y < —T\Je/5. 
To prove the second inequality of (|5.4[) we consider the identity, 

C 4 Sy 



(5.126) P[Y e (T-6)> 



T 



Y £ (0)=y, Y £ (T)=Q 



G(y, 0,0, T)- 1 / d(G(y,t,Q,T-S)G(£,0,T-5,T). 

JCiSy/T 

We now choose C4 to satisfy < C4 < 1 and proceed as previously. □ 



6. Representation formula for the Stochastic Cost function 

Corollary 4.1 suggests that we may take the limit S — > in (|3 . 55[) by setting 
lim E[q e (x,y e (T — S),T — 6)] = 0, but it does not prove it. In fact Lemma 3.1 

5— >0 

shows that q e (x,y e (T — S),T — S) becomes arbitrarily large for y close to x with 
y < x as 5 — ► 0. To deal with this problem we need to obtain a sharper lower bound 
on —dq £ {x, y, t)/dy than in (|4.2p . in particular one that does not decay as y — * —00. 
In the linear approximation b(y,s) = A(s)y, one can express —dq e (0,y,0)/dy for 
y < by the formula, 



3-D 



ag E (0,y,0) 
dy 



eA(T) 



N/2^a 2 (T) 



exp 



A(T)V 



2ea 2 (T) 



HT)y 



where $ is the cumulative distribution function for the standard normal variable 
and A(T), a 2 (T) are given by (|5.1j) . Hence provided AT < 1 we see from (|4.12p 
that 



(6.2) 



-^(o,y,o) 



A(r) 2 ?y 

tr»(T) ' 



y/V^T « -1. 



Comparing (|6.2p and (|4.2p . we see that the exponential factor in (|4.2p may be 
removable in the case of nonlinear &(■, •). We prove this in the following: 

Lemma 6.1. Suppose &(•,-) satisfies il.l]) and let q e (x,y,t), i,|/e R, t <T, be 
defined by \1. 7| ). T/ien f/iere are universal constants C, 77 > swc/i </iat 



(6.3) 



dq £ (x,y,t) 
dy 



> 



F{x,t)~y 
T-t 



-CA(T-t) 



provided < t < T , A(T — t) < r/, y < F(x, t), where F(x, t) is the function defined 

from arm . 



Proof. From (|4.17|) we see that 



(6.4) 



> e 



-A(T-t) £ X, t, r) 

G(y,z,t,T) dz 



Let us assume first that b(x,s) = 0, < s < T, whence F(x,t) — x, < t < T. 
From Lemma 5.6 we see that provided A(T — t) < 77 and 77 is chosen sufficiently 
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small, 
(6£) 

1^ G(y,z,t,T)d. 



sG(y,x,t,T) 



: , 1 



dt; exp 



- y) 



(T - t){l + CA(T - t)} 
x-y 



s(T-t){l + CA(T-t)}_ 

where C is a universal constant. The inequality (|6.3[) follows now from 
To deal with the more general case we make the change of variable as in (|5.88[) . 
(|5.89[) . and proceed as above. □ 

Theorem 6.1. Suppose &(•, •) satisfies i 1.1} ) and q £ (x,y,t), x,y € R, t < T, 
is defined by |i.7| ). If A e (-,-) is the optimal controller defined by 11. Iffy then for 
< t < T, x, y <G R, the functions q £ {x,y,i), dq e (x,y,t)/dx and dq £ {x,y,t)/dy 
have the representations, 



(6.6) 



(6.7) 



q £ (x,y,t) = E 



[My £ (s), s ) - KVe{s), s)\ ds I y e (t) = y 



dq e {x,y,t) 



dy 



T-t 



E ■ 



' r i + (T-s)^(y e (s),s) 



[A £ (y e (s), s) - b(y £ (s), s)] ds I y £ (t) = y } , 



(6.8) 
1 

T-t 



E ■ 



-jx,y,t) = 



[A e (y e (s), s) - b(y e (s), s)] ds I y £ (i) = y > , 



where y £ (s), t < s < T, is the solution to the SDE \1. 1J$ with initial condition 

vS) = v- 

Proof. From (|3.55|) the representation (|6.6p for q £ (x,y,t) holds provided we can 
show that 



(6.9) 



lim E [q £ (x, y £ (T - S),T - S) | y £ (t) = y] = 0. 

5 — >0 



In view of Lemma 3.1 and Corollary 4.1, (|6.9[) will follow if we can show that for 
M > 1, 

(6.10) 

limsup E \q £ (x, y £ (T - 5),T - 5) ; y £ (T - 6) < x - AlVTS I y £ (t) = y] < c(M), 

where the constant c(Af) satisfies limM^oo c(M) = 0. To prove (|6.10[) we use 
Lemma 6.1. Thus let t < T be such that CAiT - t ) < 1/10, where C is the 
constant in (|6.3p . If in addition A(T — to) < 1/10 then y £ (s) satisfies the differential 
inequality, 

"3 {x- y £ {s)} 
4 



(6.11) 



dy £ {s) > 



2 sup \b(x,s')\ 

s<s'<T 



ds 



fe dW(s), 



T-s 

provided to < s < T, and y £ (s) < x. If t > to then we see from (|6 . 1 1 [) . by following 
the argument of Lemma 4.2, that for 5/ (T — t) < 1/K, 

(6.12) P (y £ (T -5)<x-p\ y £ {t) =y)< exp [~ P 2 /20e6] , 
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provided p > KyeS and the constant K depends only on x, y. Evidently (|6.10|) 
follows from (|6.12|) on using Lemma 3.1. If t < to then one can argue as in Theorem 
4.1 equation (I4.37|) that the probability of y s (to) conditioned on y e (t) — y being 
very negative is extremely small. Then one applies (|6.1ip for to < s < T to show 
that (|6.10p holds in this case also. We have obtained the representation (|6.6[) . 

To prove (|6.7p we proceed in a similar way to how we obtained the analogous 
representation (|2.29|) in the classical case. Thus let y £ (s),t < s < T, with y £ (t) = y 
be as before and for Ay e R define y e ,A y (s) by 

(6.13) y e , Ay (s)=y e (s) + (T-s)Ay/(T-t), t<s<T, 

so that y e Ay(t) — y + Ay and y e Ay(s) satisfies the SDE 
(6-14) 

dy s ,Ay(s) = [A e {y e , Ay (s) - (T - s)Ay/(T - t),s) - Ay/ (T - t)} ds+^dW{s), t<s< 
Then by Lemma 3.2 there is the inequality 

(6.15) q e (x,y + Ay,t)<E{q e (x,y £ (T-S)+SAy/(T-t),T-S) \ y s (t)=y} 
+ E {\J f Me{s), a) - Ay/ (T - t) - b(y s (s) + (T - s)Ay/{T - t),s)} 2 ds \ y £ (t) = 

where we have used the fact that (|6.13[) gives the solution to (|6.14[) . Since by the 
argument we used to establish (|6.6[) one has that 

lim E {q e {x lVe {T - 5) + SAy/(T -t),T - S) | y s (t) = v) = 0, 
we conclude from (16.15|) that 

(6.16) q e (x,y + Ay,t) < 

E{\J [X e (y e (s), s) - Ay/ (T - t) - b(y E (s) + (T - s)Ay/{T - t), s)} 2 ds \ y e (t) = v}- 
To see that the RHS of (|6.16p is finite, it will be sufficient to show that 

(6.17) \ £ (y e ( S ),s) 2 ds\y e (t)=y^ < oo. 

Observe that the inequality (|6.17p does not follow in a straightforward way from 
the fact that y £ (s) is a solution to (|1.14|) . where A e (-,-) is given by (|1.16p and 
—dq e (x,y,t)/dy satisfies (|6.3p . In fact for Z E (s) the solution to (|4.28p . it is easy to 
see that 



E \ I ^ \ 2 ds | Z s (t) = z} = 



(T-sf 

for all ii > 0. To prove (I6.17P we use the fact that the LHS of (16. 6p is finite. Hence 
(|6.17|) follows if we can show that 

(6.18) E^ y e (s) 2 ds | y e (t) = j/ 1 < oo. 

It is easy to see that f|6 . 1 8[) is a consequence of the fact that X E (y, s) > b(y, s), y S 
R, t < s < T, and Lemma 3.4. Here we use the fact that Lemma 3.4 implies that 
for any r/ > 0, X e (y, s) is uniformly Lipschitz in y in any region y > x+r). t < s < T. 
Having established (|6.17p , we obtain from (|6.6p . (]6 . 16[) the inequality 
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(6.19) limsup[q s (x,y + Ay,t) - q £ (x,y,t)}/ Ay < 

Ay^O 



1 



-E- 



l + (T-s) — (y s (s),s) 



[A e (y e (s), s) - b(y e (s), s)] ds I y e (t) = y 



T-t 

Next in analogy to (|6.16[) we have that 

(6.20) q e (x,y,t)< 

E {\j t ^(y^> s ) + A y/( T b ^ - ( T - s ) A y/( T - *)> s )f ds I = ih 

Using now (|6.6p with y replaced by y + Ay we conclude from (|6.20p that 

(6.21) liminf [q E (x, y + Ay, t) - q E (x, y, t)]/Ay > 

Ay^O 



1 



-E- 



T-t 

provided we show that 



db 

l + (T-s) — (y s (s),s) 



[A e (y e (s), s) - b(y e (s), s)] ds I y s (t) = y\, 



(6.22) 



(6.23) 



lim E 



\ye,v( s ) ~ Ve,o( s )\ ds 



lim E 



\^e(y s ,r,(s),s) - \ e (y St0 (s),s)\ ds 



= 0, 



where y £ . ri (s), t < s < T, is the solution to (|1.14| with initial condition y e/q (t) = 
y + ?y. To prove (|6.22[) we use the uniform Lipschitz continuity of A £ (z, s) in any 
region z > zq, t < s < T — 5, where 5 > 0, zq € R can be arbitrary. Thus by 
introducing a stopping time and using the fact that the probability of y StV (s) being 
large and negative is very small we see that 

r T-S 

\Ve, v (s) - 2fe,o(s)| ds 



(6.24) 



lim E 



0. 



Now (|6.22p follows from ()6.18j) . (|6.24|) using the fact that one can obtain a bound 
in (|6.18|) which is uniform in r\ for small r\. To prove (|6.23p first observe that (|6.6p 
implies that 



(6.25) 



sup E 

M<>7o 



X e (y StV (s), s) 2 ds \ < oo, 



for any t/q > 0. Thus it is sufficient to show that 

r T-8 

|A s (y e ,^(s),s) - X £ (y efi (s),s)\ ds 



(6.26) 



lim E 



= 



for any 5 > 0. For any zq £ R we introduce a stopping time t v (zo) = inf{s > t : 
ye,))( s ) = z a}- From the uniform Lipschitz continuity of A e (z, s) in z > zq, t < s < 



T - 5, and (pT24"|) we have that 

r (T-6)ATr,(zo)AT (zo) 

(6.27) hm E 

7]— »0 



|A e (j/ £ ,„(s),s) - A £ (y e ,o(s),s)| ds 
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The expectation in (|6.26|) exceeds the expectation in (|6.27|) by at most 
(6.28) 



2P(t v (z q ) A t (z ) <T-5) sup E 

t<t'<T-S 



T-5 



\^e(Ve[s), s)\ ds I y s (t') = Z 



Since X e (z,s) > b(z, s), z E R, t < s < T, the probability in (|6.28j) is decaying 
exponentially fast in zq as zq — > — oo. In contrast the expectation in (|6.28p is 
increasing at most linearly in \zq\ as zq — > — oo. This follows from the representation 
(|6.6p for 5 e and Lemma 3.1. Hence the expression in (|6 . 28[1 converges to as 
zq — » — oo, whence we conclude that (|6.26[l follows from (|6.28| . We have proved 
([6T23]) . Now J6J]) follows from (|6T9| . fOQ - The proof of (EH) is similar to the 
proof of ([67f|. □ 



Once we have the representations in Theorem 6.1 for q e (x,y,t) and its first 
derivatives, the inequality (|1.22p easily follows. 

Corollary 6.1. Suppose the function &(•, •) satisfies the Lipschitz condition (1.1]) . 
Then for x, y € R, t < T, the following inequalities hold: 



(6.29) 



dfk 
dx 

dy 



(x,y,t) 
(%,y,t) 



< 



< 



l + (T-t)A\ [2q e (x,y,t)/(T-t) 
l + (T-t)A] \2q e (x,y,t)/{T-t) 



1/2 
1/2 



Proof. This follows from Theorem 6.1 on using the representations (|6.6[) . (|6.7p . (|6.8p 
and applying the Schwarz inequality in (|6.7p . (|6.8p . □ 



7. Proof of Theorem 1.3 



In order to prove convergence of first derivatives in x and y of the function 
q e {x, y, t) defined by (|1.7p to the corresponding derivatives of the function q[x, y, t) 
defined by (jl.lOp as e ~> 0, it will generally be necessary to assume the concavity 
in y of the function b(y,t) in (|1.2p . Recall however that q(x,y,t) = if y > 
F(x,t), where F(-,-) is the function defined from (jl.lip . Thus for y > F(x,t) the 
derivatives of q(x,y,t) are 0. In this case it easily follows from Corollary 6.1 that 
the derivatives in x or y of q e (x,y,t) converge to as e — * 0, without making any 
further assumptions on the function &(•, •) beyond the Lipschitz condition (jl. 1|) . 

Corollary 7.1. Suppose b(-, •) satisfies and the function F(-, ■) is defined from 

11.11]) . Then for < e < 1 there is a constant C(x, y, t, T) such that 



(7.1) 



dy 



provided y > F{x,t). 



Proof. The inequality (|7.ip follows from Theorem 1.1 and Corollary 6.1 since q(x, y, t) 
for y > F(x,t). □ 

In order to show convergence when y < F(x,t) we shall need to assume &(•, •) 
is concave as well as that (jl.ip holds. We first prove a result about the classical 
problem. 



GO 



JOSEPH G. CONLON AND MOHAR GUHA 



Lemma 7.1. For a > let y a (s), < s < T , be the solution to the equation 

(7.2) ^ = b(y a (s),s) - a ^- (x,y a (s),s), < s < T, y a (0) = y, 

where (/(•, •, •) is the classical cost function M.10\) . There there is a constant C(AT) 
depending only on AT such that 



(7.3) < y a (s) - y (s) < max[l, a] C{AT) y/Tq(x,y,0), < s < T. 

Proof. We first consider the case a = 1 since yi(-) is the optimal trajectory for the 

variational problem (|2~^|) . From l|2.2p . (|2.14p we see that 

(7.4) 

d(AT) [</(*, 2/,0)/T] 1/2 < ^W-6( yi ( s ), s ) < C 2 {AT) [ q ( Xl y,0)/T] 1/2 , < a < T, 

ds 

for some positive constants C\, Ci depending only on AT. Setting (fi(s) — yi(s) — 
yo (s) it follows from (jT~2"|) . ([7^1 that 

(7.5) ^A^^ + ^^fe^^^O)/^ 1 / 2 , 0<s<T, ^i(0) = 0. 

Applying Gronwall's inequality to (|7.5[) we conclude that (|7.3p holds for a = 1 and 
a- fortiori for < a < 1. 

Suppose now that a > 1 in which case y a (s) > yi(s), < s < T. Using the fact 
that q(x,y,t) is convex in y, we see from (|7.2j) that 

%^ < b(y a (s),s) - a ^(x, yi (s), s), < s <T. 
ds ay 

Thus if ifia(s) — y a (s) — 2/o (s) w e have that 

\v' a (s)\ < A Va (s)+aC 2 (AT) [q(x, y, 0)/T] 1/2 , 

whence (17.31) follows for a > 1 as before. □ 



We can use the method of Lemma 7.1 to find a region where the paths y e (s), < 
s < T, for the stochastic control problem (|1.14|) , (| 1 . 1 5|) are most likely to be found. 

Lemma 7.2. Let y e {s), < s < T, be the solution to the stochastic equation \1. 1J$ 
with y e (0) — y, where A e (-, •) is given by (1.16\) . Then there is a universal constant 
M and a constant C(AT) depending only on AT such that 



(7.6) P 



< exp [-p 2 /eT C(AT)] 



provided p 2 > MeT C(AT). There is a further constant C\(x,y, A,T) depending 

only on x, y, A, T such that 

(7-7) 



P 



sup [y e (s) - y (s)} >p + C(AT)^/Tq(x, y, 0) + d(x, y, A, T)^/ 4 

0<s<T 



< exp [- P 2 /eT C(AT)] , 



provided p 2 > MeT C(AT). 

Proof. The inequality (|7.6p is obtained by using the fact that y e (s) > Y s (s), < 
s < T, where Y e (0) = y and Y e (-) satisfies (|1.5p . Then one compares solutions of 
(|1.5p to solutions of the deterministic equation (|7.2p with a = 0, using the Lipschitz 
property (jl.ip of &(•, •) and applying Gronwall's inequality. 

To obtain the inequality (|7.7p we need to use the convexity of the function 
q e {x, y, s) in y, which is established in the Appendix (Theorem Al). Let y c (s), < 
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s < T, be the optimal trajectory y(-) for the variational problem (ll.lOp with y(0) = 

y. Then if y > y c (s) we have from Corollary 6.1 that 

(7.8) 

< ~^(x, y, s) < -^(x, y c (s), s) < (1 + AT) [2q e (x, y c (s), s)/(T - s)} 1/2 . 

From Lemma 3.3 we see that there is a constant C 2 (x, y, A, T) depending only on 
x, y, A, T such that 

(7.9) q e (x,y c (s),s)<q(x,y c (s),s) + C 2 (x,y,A,T)Vi, < s < T. 

Putting (|7.8[) . (|7.9[) together and using the fact that (|7.4p holds for y c (-), we conclude 
that 

(7.10) < -^(x, y, s) < C^AT) [q{x, y, 0)/T] 1/2 

+ C 3 (x, y, A, T)e^ 4 /VT~s, < s < T, y > y c (s). 

Consider now the diffusion process Z e (-) defined as a solution to the stochastic 
equation 

(7.11) dZ e (s) =fj, e (Z e (s), s)ds + y/e dW(s), < s < T, 
where •) is given by the formula 

dq^ 

(7.12) He{z,s) = b(z,s) - -^-(x,z,s) 7 z<y c (s), 

tx e {z,s) = b(z,s) + C 1 (AT)[q(x,y 1 0)/T} 1/2 

+C 3 (x, y, A, T) s 1/4 /VT^7s, z > y c (s). 

Then if Z e (Q) > y e (0), it follows from ([7T0| that Z e (s) > y e (s), < s < T, with 
probability 1. 

For any t, < t < T, suppose that zq > y c (t) and consider the solution z(s) to 
the initial value problem 

(7.13) dz(s) = n £ (z(s), s)ds, t < s < T, z(t) = zq. 

By letting e — * in (|7.10|) we see that z(s) > y c (s), t < s < T. Hence on setting 
4>{s) = z{s) — y c (s) we have from (|7.13|) and the Lipschitz property of 6(-, •) that 
(7.14) 

-A<f>(s) < </J(s) < A^+d (AT) [q(x, y, 0)/T} 1/2 +C 3 (x, y, A, T) s^/VT^l, t<s<T. 
Integrating (|7. 14[) we conclude that 

(7.15) [z - y c (t)]e~ AT < z(s) - y c (s) < 

e AT { [z - y c (t)} + d(AT) [Tq(x, y, 0)] 1/2 + IsFt C 3 (x, y, A, T) e 1/4 } , t < s <T. 

We can compare the solution of (|7.13[) to the solution of the stochastic equation 
(|7.11[) with initial condition Z e (t) ~ zq > y c (t)- Arguing as in Lemma 3.1 we see 
that 



(7.16) P[ sup \Z e {s) - z{s)\ > 5 < exp - 5 Z / eT C 2 (AT) 

\t<s<T ) L 

where the constant C 2 {AT) depends only on AT. Also 5 must satisfy the inequalities 

(7.17) 8 < [z - y c (t)} e- AT , S 2 > MeT C 2 (AT), 
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where M is a universal constant. The first inequality in (|7.17|) ensures by (|7.15j) 
that if \Z e (s) — z(s)\ < S then Z £ (s) > y c (s). Hence to estimate the probability 
(|7.16p we can assume the drift /x E («, *) of (|7.1ip is given by the second formula in 

To prove (|7.7p first observe that the probability in (|7.7p is bounded above by the 
probability 
(7.18) 

1 + 2e AT 

sup [y e (s) - y (s)} > nn ■ aAT rj 



sup P 

0<t<T 



2(1 



Ve{t) - yo(t) = 



V 



2(1 



t<s<T 

where i] is given by the formula 

(7.19) n = p + C{AT) ^Tq{x, y,0) + C 1 (x,y, A, T) e 1/A . 

The probability in (f77T8|) is in turn bounded above by the same probability with 
y e (s) replaced by Z £ (s). Observe next that 

1 + 2e AT 



(7.20) 



Z e (s)-yo(s) > 



2(1 



n 



Z E (s) - z(s) > tj/4 , 



where we have used the fact that zq — yo(t) = 77/2(1 + e AT ) and the inequalities 
(TT3|) . ([7T51) . The constants C(AT) and Ci[x,y,A,T) in (fTT9)l must also be cho- 
sen sufficiently large. Hence the probability in (17. 18[) is bounded above by the 
probability 

-AT 



(7.21) P sup \Z e (s)-z(s)\ > 

\t<s<T 4(1 



,AT\ 



Z E (t)-y (t) 



V 



2(1 



a AT 



It is clear from (|7.3p that if the constant C (AT) in (|7.19p is chosen sufficiently large 
then we may apply (|7.16p to estimate (|7.21|) . since for C(AT) large enough the first 
inequality in (|7.17p is satisfied. Now (|7.7|) follows from (|7. 16|) since the condition 
on p implies the second inequality in (|7.17p . □ 

Lemma 7.3. Let y £ {s), < s < T , be as in Lemma 7.2 and y c (s), < s < T, 
be the solution to the corresponding classical problem ll.lQj) which has optimal 
controller A c (s), < s < T. Then there is a constant C(x,y, A,T) such that 
(7.22) 

eU [X e (y e (s), s) - b(y e (s), s) - X c (s) + b(y c (s), s)} 2 ds^j < C(x, y, A, T)^/ 4 . 

Proof. Following the argument of Lemma 3.5 we define a classical path y e , c {-) which 
corresponds to the stochastic path y £ (-) by 

d Ve.c( s ) 



(7.23) 



ds 



X e (y s (s),s) + k/T, 0<s<T, 



where y e c (0) — y and k is defined by 



(7.24) 



k = max 



x-y 



X £ {ye(s),s)ds, 



Observe from Lemma 4.1 and Theorem 4.1 that the integral on the RHS of (|7.24p 
exists with probability 1. Letting a be an arbitrary number, < a < 1, and using 
the fact that y £jC (T) > x, we have that 
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(7.25) 

q(x, y,0)<F [a y e>c (-) + (1 - a)y c (-)\ = 1 



a{A e (y e (s),s) - 6(y e (s),s)} 



ds , 



+ (1 - a){A c (s) - b(y c (s),s)} + g e (s) - % £ (s), s) 

where the deterministic function h(z, s) is given by the formula 

(7.26) h{z, s) = b(az + (1 - a)y c (s), s) - ab(z, s) - (1 - a)b(y c (s), s), 
and the random function g £ (s) by the formula, 

(7.27) g e (s) = ak/T + b{ay £ {s) + (1 - a)y c {s), s) - b(ay £ . c {s) + (1 - a)y c (s),s). 
We expand out <7 e (-) in the quadratic expression in (|7.25[) to obtain the inequality 



(7.28) q(x,y,0) < \ [ g e (sf ds + 

z Jo Jo 



\g s (s)\ \h(y e {s),s)\ ds + 



\g e (s)\ \X c (s)-b{y c (s),s)\ ds + / \g e (s)\ \\ e (y e (s),s) - b(y £ (s),s)\ ds + 



a{K{ye(s), s)-b(y e (s), s)} + (l-a){X c (s)-b(y c (s),s)}-h(y e (s), s) 



ds. 



1 

2 jo 

Since 6(-, s) is concave for < s < T, it follows that the function h is non-negative. 
Thus since [X £ (y e (s), s) — b(y £ (s), s)] and [A c (s) — b(y c (s), s)] are both non-negative, 
one has the inequality 



(7.29) 

1 f 

2 Jo 

a 

< — 
~ 2 



*{K(ye{s),s)-b(y £ (s),s)} + (l-a){\ c {s)-b(y c (s),s)}~h(y £ (s),s) 



ds 



A e (2/ e (s),s) - b(y E (s),s) 



2 , 1-a 
ds+ — 



A c(s) - b(y c (s),s) 



A e (2/e(s), s) - b(y £ (s),s) - A c (s) + b(y c {s), s) 



ds 



ds , 



provided that h(y £ (s),s) < 2(1 — a)[X c (s) — b(y c (s), s)] for < s < T. Since we also 
have that h(z, s) < 2Aa (1 — a)\z — y c (s)\, we conclude that (|7.29p holds provided 
y £ {-) satisfies the inequality 

(7.30) Aa\y £ (s)-y c (s)\<[X c (s)-b(y c (s),s)}, < s < T. 

If we now use (|7.3[) and the lower bound in (|7.4p we see that (|7.30p is implied by 
the inequality 



(7.31) \y £ (s) - y (s)\ < [a' 1 C\ (AT) - C 2 (AT)] y/Tq(x,y,0), < s < T, 

for some positive universal constants Ci(AT), C2(AT) depending only on AT. 

Observe now that from Theorem 1.1 the inequality (|7.22[) holds if Tq(x, y, 0) < 
e 1 / 4 , whence we may assume Tq(x,y,0) > e 1 / 4 . It follows then from Lemma 
7.2 that, for a sufficiently small depending only on AT and e sufficiently small 
depending only on x, y, A, T the inequality (|7.3ip holds with probability close to 1. 

We estimate the expectation of the terms in g £ (-) on the RHS of (|7.28p . From 
Theorem 4.1 it follows that the quantity k in (|7.24[) satisfies the inequality 

(7.32) < k < Ve max[W(T), 0], 
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where W(-) is Brownian motion. We also have from (|1.14|) . (I7.23|) that 
(7.33) sup \y e (s) - y e , e (s)\ < y/i sup \W(s)\+k. 

0<s<T 0<s<T 

We may bound the random function g £ (-) of (|7.27[) using (|7.32[> . (|7.33[) to obtain 

2a y/e 



sup \g £ (s)\ < 

0<s<T J 



(7.34) 

Evidently (|7T3l| implies that 



(7.35) 



E 



9e(s) 2 ds 



[l + AT] sup \W{s)\. 

0<s<T 



< a 2 eC 3 (AT) 



for a constant C$(AT) depending only on AT. The inequality (|7.35|) in turn implies 
by the Schwarz inequality that 



(7.36) E 



\g £ (s)\\\ c (s) - b(y c (s),s)\ ds 



< e 1 ' 2 a C 4 (AT)[l + q(x,y,0)} 



for a constant Ca{AT) depending only on AT. Similarly one has by Theorem 1.1 
that 



(7.37) E 



\9e{s)\ \X s (y e (s),s) -b(y e (s),s)\ ds 



< ^feaC 5 {AT) 1 + q(x, y, 0) + C 6 (x, y, A, T)y/e\ , 



for constants C$(AT) depending only on AT and Cq(x, y, A, T) on x,y,A,T. The 
final term involving g e (-) can be estimated by using Lemma 7.2. Thus 



(7.38) E 



\g e (s)\ \h(y £ (s),s)\ dt 



< a^fe C 3 (AT) 



2Aa(l - a)E 



1/2 



\y s (s) - y c {s)\ 2 ds 



1/2 



and the expectation on the RHS of (|7.38|) is bounded as 



(7.39) E 



\y s (s) - y c (s)\ 2 ds 



< 



C 7 (AT) {T 2 q(x, y, 0) + C 8 (x, y, A, T)e x l 2 } 



Let us define now p £ as the probability that the inequality (|7.31|) is violated, and 
take the expectation of (|7T28|) over the event (|7T3T|l . Thus from (fT28|) . (|7T29| and 
([7351 - (|739| we conclude that 



(7.40) 
a(l — a) 



E 



[X e (y £ (s),s) - b(y £ {s), s) - A c (s) + b(y c (s), s)} 2 ds ; $TM holds 
p £ + e 1/2 a C 9 {AT)] q{x, y, 0) + aC w {x, y, A, T)e 1/A . 



< 
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Since we can estimate p £ from Lemma 7.2, we can conclude (|7.22j) from (|7.40p 
provided we can estimate the expectation 



(7.41) 



E 



/ [X e (y £ (s),s) - b(y £ (s), s)} 2 ds ; f7T3~Tj) does not hold 
Jo 



appropriately. We have now from Corollary 6.1 that 

rT-8 



(7.42) E 



pi— a 

I [X e (y s {s),s) — b(y e (s), s)) 2 ds ; ()7.31|) does not hold 
Jo 



pT-5 

<4^ 2 (1 + AT) 4 

Jo 



E[qc(x,y £ (s),s) 2 } 1/2 



T-s 



Let Y e (s), s > 0, be the solution to (|1.5|) with 5^(0) = y. Recall that since 
dq £ (x, z, s)/dz < Owe have that y £ {s) > Y E (s), s > . Using Lemma 3.1 then, we 
conclude that 

(7.43) E[q e (x,y £ (s),s) 2 ] < j [C 3 (AT)E [{x - Y £ (s)} 4 ] +C^x,y,A,T)]. 
We are left now to estimate 

i-T 



(7.44) 



E 



f 1 2 

/ [^e{ye{s), s) — b(y s (s),s)] ds ; (|7.31|) does not hold 



for some 5 > 0. Instead of attempting to show that the expectation (|7.44ll is small, 
we consider as in (I7.29[) under what circumstances the inequality 



(7.45) [a{X(y e (s),s) - b(y e (s), s)} + (1 - a){X c (s) - b(y c (s),s)} - h(y £ (s), s) 
< § [X £ (y £ (s),s) - b(y E (s), a)] 2 + ^-^ [X c (s) - b(y c (s), s)] 2 



a(l — a) 



[A E (t/ s (s), s) - b(y £ (s), s) - X c (s) + b(y c (s),s)] ' 



holds if s lies in the region T — 5 < s < T. From Theorem 4.1 we see that if 6 > 
is sufficiently small depending only on A, then (|7.45|) holds if y £ (s) satisfies the one 
sided inequality 



(7.46) y e (s) - y (s) < [or x C x {AT) - C 2 (AT)] y/Tq{x,y,0) 

similar to (|7.3ip . Thus instead of estimating (|7.44|) it will be sufficient to estimate 



(7.47) 



where 



E 



T-S 



[X £ (y £ {s), s) - b(y £ {s), a)] x(t/ E (s), s)d& 



(7.48) X (z, s) = 1 if z > y (s) + [a^C^AT) - C 2 (AT)] y/Tq(x,y,0), 
x(z, s) — 0, otherwise. 

Using (|7.8| . (|7.9p we see that if x(Vs(s),s) = 1 then [X £ (y £ (s), s) — b(y £ (s), s)] 2 is 
bounded, whence we conclude that the expectation (|7.47[) is bounded by C(x, y, A, T) 
for a constant C(x,y, A,T). The result follows from Lemma 7.2. □ 
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Proof of Theorem 1.3. We use the representation for dq(x, y, t)/dy given by (|2.29p 
and for dq £ (x, y, t)/dy by (|6.7|) . Thus we have that 

(7.49) ^L( X ,y,0)-^k( X ,y,0) = 



1 

T' 



-E- 



' \ + (T-sAy e (s),s) 



dy 

l T E \[ {T - S) 



[Ae(y e (s)) s) - b(y £ (s),s) - X c (s) + b(y c (s), a)] ds 



[A c (s) - b(y c (s),s)]ds j 
In view of Lemma 7.3 the second identity of (|1.25|) follows if we can show that 



ds} =0. 



(7.50) lim E i£\^(y E (s), S )-^(y e (s),s) 

We put </> e (s) = y e (s) — y c {s), < s < T, and observe that e (s) satisfies the 

equation, 

(7.51) 

d(f> £ = MVeis), s) - b(y e (s),s) - A c (s) + b(y e (s), a)] ds + y/i dW(s), 0(0) = 0. 

It follows from ([731]) that 
(7.52) 

sup |4(s)l< / \K(y s (s),s)-b(y E (s),a)-X c (a)+b(y e (8) ) a)\d8+^ sup \W(s)\. 

0<s<T Jo 0<s<T 

One easily sees from (|7.52l) and Lemma 7.3 that (|7.50[) holds. We have proved the 
second identity of (|1 .25|) . The first identity follows in a similar way. □ 

Appendix A. Log Concavity of Solutions to Linear Diffusion 

Equations 

Our goal in this appendix is to establish convexity properties of the function 
q s (x,y,t) defined by (jl.7p . We shall first show convexity in y for fixed x € R, 
t < T, since showing joint convexity in (x,y) is considerably more difficult. We 
consider the terminal-boundary value problem 



(Al) 



dw 



dw e d 2 



dt ' dy ' 2 dy 2 



= 0, y > 0, t < T, 
w(0,t) = 0, t<T. 



w(y,T) = w (y), y > 0; 

Proposition A.l. Assume b(-,-) satisfies 1 1.1]) and the terminal function wo(y) 
is C 2 for y > and C 1 for y > with wq(0) — 0. Assume further that 

(A.2) sup{K(y)| + \dw (y)/dy\ + \d 2 w (y)/dy 2 \} < oo. 

Then there is a unique solution w(y,t), y > 0, t < T, to the terminal-boundary 
value problem \A . 1]) which has the property that w(y, t) is C 2 in y, C 1 in t, and 
satisfies the inequality 

(A.3) sup {\w(y,t)\ + \dw(y,t)/dy\ + \d 2 w(y,t)/dy 2 \} < oo 

y>0,T o <t<T 

for any Tq < T. In addition, the functions w(y,t) and dw(y,t)/dy are continuous 
fory>0, t< T. 
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Proof. We first observe that the result holds when 6=0. In this case the solution 
is given by the method of images as 

/>oo 

(A.4) w(y,t)= [G(y-y',e(T-t))-G(y + y',e(T-t))]w (y')dy', 
Jo 

where G(-, s) is the pdf of the Gaussian variable with mean and variance s. Thus 
on using integration by parts we have 

(A.5) ^(y, t) = J™ [G(y - y', e(T - t)) + G(y + y', e(T - t))] dy', 

where we have used the fact that wo(0) = in deriving (|A.5|) . On using a further 
integration by parts we have that 

(A.6) t) = J™ [G(y - y', e(T -t))-G(y + y', e{T *))] dy' . 

It follows easily from (|A.4|> . (|A.5|) . (|A.6|) that (|A.3|) holds. In addition w(y,t) and 
dw(y,t)/dy are continuous for y > 0,t < T. We also have that d 2 w(y,t)/dy 2 is 
continuous for y > 0, t <T, provided d 2 wo(y)/dy 2 is continuous in y > 0. 

To prove the result for general b(-, •) satisfying (jl.ip it will be sufficient to estab- 
lish it for t restricted to a small interval [T — A, T]. We proceed as in Lemma 3.4. 
Taking y\ = rj in (|3. 18|) we see from p,19|) that w(y, t) is given by the formula 

f 2ri f T dG 

(A.7) w(y,t)=J^ G(y,y',t,T)w {y')dy' -e J ds w+(s) — (y, 2r,, t, s), 

provided < y < 2rj. The Green's function G(y,y' ,t,T) is defined by the pertur- 
bation expansion (|3.23p . Since is bounded by virtue of (|A.2[) , we see that if 
A satisfies (|3~20| then sup{\w(y,t)\ : < y < 77, T - A < t < T} < 00 and w(y,t) 
is continuous for < y < rj, T - A < t < T, with w(0, t) = 0. 

We consider next the first derivative dw(y,t) / dy, which from (|A.7p is given by 
the formula 

dw f 2r> dG f T d 2 G 

^ A ' 8 ^ ~dy^ V,t ^ = J ~dy^ V,V t; r ) Wo ^') d2/ ' _£ J dsw +( s ) dydyl (v, 2 V,t,s)- 

It is evident from (|3.41[) that the second integral on the RHS of (|A.8|) is uniformly 
bounded in the set {(y,t) : < y < 77, T ~ A < t < T} and that the integral 
converges to as t — > T, uniformly for < y < r\. To estimate the first integral on 
the RHS of (|A.8|) we do an integration by parts for the first term in the perturbation 
expansion (|3.23[) for G(y, y', t, T). Just as in (|A.5|) we see that this term is uniformly 
bounded in the set {(y, t) ■ < y < f], T — A < t < T}, and converges uniformly 
to dwo(y) I dy as t — > T. We can estimate the higher order terms 

(A.9) / ^(y,y',t,T)w (y')dy', 

Jo dy 

for n > simply by using ()3.24|) . Thus we see that the sum of the higher order 
terms is uniformly bounded in the set {(y,t) : < y < rj, T — A < t < T}. To 
prove continuity of dw(y, t)/dy as t — > T we need to show that the integral in (|A.9|) 
converges uniformly to as t — > T in the interval < y < rj. This follows from 
(13.24[) when n > 1. To prove it for n — we again need to make use of integration 
by parts. Thus we see that 
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(A.10) I / g (z,y',s,T) w (y') dy' I < 



10 



C\b(z,s)\ 



sup \dw (y)/dy\ + G{z - 2n, 2e(T - s))\w (2r 1 )\ 

.0<y<2ij 



for some universal constant C. It follows from (|A.10j) and the representation (|3.23|) 
for vo that the integral (|A.9[) also converges to as t — > T when n = 0. We have 
shown that sup{\dw(y,t)/dy\ : < y < r], T — A < i < T} < oo and dw(y,t)/dy 
is continuous for < y < rj, T — A < t < T. 

To estimate the second derivative d 2 w{y 1 t)/dy 2 we proceed in a similar manner. 
Thus we have that 
(A.ll) 

d 2 w, . r 2 " d 2 G, , _ . , , /" T , , . <9 3 G , „ 

'dy 2 Jo ~dy 2 ^ y ~ 6 / w+(s) g 2 g y ^ iy^ 2 V,t,s). 

We wish to show that sup{|9 2 w(?/, t)/9y 2 | : < j/ < 77, T - A < t < T} < 00. In 
view of (|3.46[) it is sufficient to consider only the first integral on the RHS of (|A.11[) . 
We estimate the first term in the perturbation expansion (|3 . 23[) for G(y,y',t,T) 
using integration by parts as in (|A.6|) . The higher order terms, corresponding to 
v n (y, y' , t, T) with n > 1, can be estimated using (|3.39|) . so we are only left to deal 
with the term corresponding to Va(y, y', t, T). We can estimate this by using (lA.lOj) 
and the corresponding inequality for the derivative of go, 



(A.12) 



' % {z,y\s 1 T)w {y')dy / 







C 



A 



d: 

1/2' 



< 



A(T - t) 



sup \dw {y)/dy\ + G(z - 2 V , 2e(T - s))\w Q {2r 1 )\ 

0<y<2i7 



for some universal constant C. We have shown that sup{|<9 2 u>(?/, t)/dy 2 \ : < y < 
7], T-A<t<T}<oo. 

We can easily extend the estimates we have made on w(y, t) and its y derivatives 
in the set {(y, t) : < y < 77, T - A < t < T} to all of y > by observing that the 
function v{z,t) defined by v(z,t) — w(z + y(t),t), where y{s),s < T, is a solution 
to (fTTTTjl with y(T) = y x , satisfies the PDE 

(A.13) ^ + [b(z + y{t),t) b(y(t),t))} g + | = 0. 

Then we represent v(z, t) by a formula similar to (|A.7[) and use perturbation theory 
as before, observing that the perturbation series for the Green's function converges 
in a region {\z\ < rj, T — A < t < T}, where 77, A can be taken independent of y\. 

□ 

Theorem A.l. Suppose &(■,■) satisfies and in addition the function b(y,t) 

is concave in y for y £ R., t < T . Then for any fixed x £ R, < t < T , the 
function q £ (x,y,t) of {1. 7| ) is a convex function o/j£R. 

Proof. We shall take wlog x — 0. For 6 satisfying < 6 < 1 we define a function 
gs(z) with domain {z £ R : z > —1} by 

(A.14) = 1/(1 + ^) 2 , if-K«<-(l-i), 

^'(«) = -z/S 2 (l-S) if -(l-5)<z<0, 
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g s (0) = sj(0)=0, 
g'j(z) = 0, ifz>0. 

Evidently gs{z) is a C 2 convex decreasing function which has the property that 
gs(z) — for z > and gs(z) ~ A^ — log(l + z) as z — > — 1, where is a constant 
depending on (5. For A > and y > —A let ta v t be the first hitting time at —A for 
the diffusion Y e (s), s > t, of (| 1 . 5|) with Y £ (t) = y. We define a function u £ a s(y,t) 

by 

(A.15) u e ,A,*(y> t) = E {exp (F E (T)/A)] ; r A , w ,t > T} . 

Letting S — > in (|A.15[) we conclude from (IA.14[) that 

(A.16) P(Y £ (T) >0; T A , y , t > T \ Y e {t) = y) = \imu eAt5 {y,t). 

It is also clear from (11.61) that 



(A.17) u e (p,y,t) = lim P (Y e (T) > ; r A , y , t > T \ Y e (t) = y) ■ 

A— >oo 

We conclude from (|A.16j) . (|A.17|) that the convexity of q e (Q,y,t) in y follows from 
the log concavity of the function u StAt s(y, t) in y. 

To prove log concavity we first observe that u e<Ai s(y,t) satisfies the PDE (|1.2p 
for y > —A, t <T, with Dirichlet boundary condition u StA) s(y,t) = at y = —A, 
and terminal data 

(A.18) u etAiS (y,T) = exp[-g 5 (y/A)], y > -A. 

Since the function (|A.18[) is increasing in y, it follows from the maximum prin- 
ciple that for t < T the function u £jA .s{y,t) is also an increasing function of y. 
From (|A.14|) we see that u e ^ s (y,T) is C 2 for y > -A and u SjAt g(-A,T) = 0, 
du e _A,s{—A-,T)/dy > 0. We may therefore apply the regularity result of Proposi- 
tion A.l. It follows from this and the Hopf maximum principle j!9j that 

(A.19) du etA>s (-A, t)/dy > 0, t < T. 

Next as in (|1.7p we put u £tAt s(y,t) = exp[—q £i \ t s(y,t)/e], and observe that 
Qe,A,s(y,t) satisfies the PDE (|1.8|) . Since u EyA ,s(y,t) is an increasing function of 
y, it follows that q e . A ,s(y,t) is a decreasing function of y. Hence q s , A ,s(y,t) is a 
solution to the PDE 

(A - 20) -ar + 2 ~w~ ~ B \ vX —) ={] ' 

where the function B(y,t,p) is defined by 

(A.21) B(y,t,p)=b(y,t)\p\+p 2 /2. 

Observe that the function B(y, t,p) is concave in y for all p £ R, t < T. Applying 
Theorem 4.1 of [9] to (|A.20[) we see that q e ,A,s(y, t) is convex in y for y > —A, t <T, 
provided we can show that the expression 

(A.22) qeAA(y + 1/0/2, t) - [q e , A ,s(y> *) + &,A,«(l/, t)] /2 

is less than or equal to as (y,y',t) approaches (j/oo)2/oo)£°o) with too < T finite, 
and (2/00, y'oo) on the boundary of (—A, oo) 2 c R 2 if too < T, and an arbitrary point 
in the closure of (—A, oo) 2 if too = T. 

Suppose now that yoo = —A and —A < y'^ < 00. From (|A. 15|) we see that 
Ue,A,s(y,t) > for y > —A, t < T, whence the limits of the first and third terms 
in (|A.22|) are finite as (y,y',t) — » (y 00, y'oo, too), whereas the second term converges 
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to — oo. Thus we may assume y'^ = j/oo = — A. In that case we observe that the 
exponential of times the expression (|A.22j) is the same as 

(A.23) Km(w. *) ^,A,s(v'> t)f 2 S,A, S ({V + 2/'}/2, *)■ 

From (|A.19|) we may write (| A.23|) as 

(A.24) p(z,z',t) (zz 1 ) 1 ' 2 / [(z + z')/2], 

where z = y + A, z' = y' + A, and lirn{p(z, z' . t) : z, z' — > 0, i — » too} = 1. Thus 
since arithmetic mean exceeds geometric mean, it follows from (|A.24|1 that the limit 
of (|A.22|I as (y, y', t) — > (—A, —A, t^) is less than or equal to 0. 

For too = T we need to show non-positivity of (|A.22|) for any {yoo,y'oo) m the 
closure of (—A, oo) 2 . This follows from Proposition Al and the convexity of g${-). 

□ 

Theorem A. 2. Suppose £>(•,•) satisfies U.l\) . Then d 2 q £ (x,y,t)/dxdy < for 
x,y G R, < t < T. 

Proof. It will be sufficient to show that for any h > the function q £ (x + h, y, t) — 
q e (x,y,t) is a decreasing function of y. Letting g(z) be the function 

(A.25) g(z) = z 2 , z < 0; g(z) = 0, z > 0, 

we define u £ ^(x,y,t) similarly to (|A.15|) by 

'Y e (T)-x y 



(A.26) u £ , s (x,y,t) = El exp 



Y e (t)=y 



Evidently lim,s_>o U Et s{x, y, t) = u £ (x,y,t) and hence the function q £ ^(x,y,t) = 
— e \ogu £ .s{x, y, t) satisfies lim^o Qe,s(x,y,t) — q s (x,y,t). Arguing as in Lemma 
3.1, we also see that q £ ,$(x,y,t) satisfies the inequality 

(A.27) Q<q e , s (x,y,t)<C[{x-y) 2 H(x-y) + l], y e R, < t < T, 

where H (•) is the Heaviside function and C a constant. 

In order to prove that q £ (x + h,y,t) — q £ {x,y,t) is decreasing in y it will be 
sufficient to show that the function v £ ,s(y,t) — q St s(x + h,y,t) — q St §(x,y,t) is 
decreasing in y for any 5 > 0. To see this we note that v £ j satisfies a PDE 

/ a 0Q ^ 9v e ,s . , / a dv £ . s e d 2 v £ . s 

(A.28) __ + My , *)__ + _ __=(), yeK 7 t<T, 

where the drift b £ j(-,-) is given by the formula 

a „M r / j\ w ,x 1 dq £ , s (x + h,y,t) 1 dq £ , s (x,y,t) 
(A.29) M„,t) = - 2 ^ 2 ^ ■ 

The terminal data for v £ ^$ is given by 

(A.30) v £ , s (y,T)= h[2(x-y) + h}/6, if y < x, 

[x + h — y] 2 /5, if x < y < x + h, 
0, if y > x + h. 

Consider now the diffusion process Y £j s(s) defined by 
(A.31) dY £tS (s) = b SjS (Y s , s {s), s)ds + dW{s). 

From Lemma 3.4 we see that the drift b £ ^s(y, s) is uniformly Lipschitz in y in any 
region y > yo, < t < T — rj, where yo S R and i] > can be arbitrary. Let T Vi t 
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be the first hitting time at yo for Y £t s(-) with Y e> s(t) — y > yo. Then we have the 
representation, 

( A.32) v e , s (y, t) = E [v Sj5 (Y Sj5 (T - rj) , T - rf) ; Ty , t > T - rj\ 

+ E[v et s(Y £t s(T yi t),T y> t) ; r y ,t <T-rf\. 

Observe that from (|A.29j) we have that & e ,<s(y, s) > b(y, s), t < s <T. Hence using 
(|A.27|) we may take the limit yo — > — oo in (| A.32|) to conclude that 

(A.33) v e , s (v,t)=E[v e , s (Y eiS (T-Tj),T-T)) \ Y e , s (t)=y]. 

If v £j s{z, T— 77) were known to be a decreasing function of z then it would follow from 
(|A.33j) that v £ ,$(y, t) is a decreasing function of y. Since u £ j(x, y,T — 77) converges 
uniformly on any finite interval a < y < b as 77 — > to the function exp[—g(y — x)/S], 
we see that v £ ^{z, T — rj) converges uniformly on any finite interval as rj — > to the 
decreasing function (|A.30[) . Thus we can still conclude from (|A.33[) that v £ ^{y,t) 
is a decreasing function of y. The result follows. □ 

It appears that one cannot prove the convexity of q £ (x,y,t) as a function of x 
for fixed y directly, in analogy to Theorem Al, so we shall proceed to showing that 
q £ {x,y,t) is convex jointly in (x,y). To do this we consider solutions v(x,y,t) to 
the semi-linear equation 

(A.34) Yt +b{y ' t] 

in the disk Dr = {(x,y) : x 2 + y 2 < R 2 }, with Dirichlet boundary condition and 
given terminal data. Thus we wish to solve (|A.34[) subject to the conditions 

(A. 35) v(x,y,T) = v (x,y), (x,y) € D R ; v(x, y, t) = 0, (x, y) € dD R , t < T. 

Using classical techniques [15] for proving regularity of solutions to semi-linear 
parabolic equations, we can establish the following result: 

Proposition A. 2. ; Assumeb{- , ■) satisfies (1.1)) and the terminal function Vo(x,y) 
is C 2 for (x, y) in the closure D R of D R , with Vq(x, y) — for (x, y) € dD R . Then 
there is a unique solution v(x,y,t), (x,y) S D R , t < T , to the terminal value 
problem {A. 3$ , (A . 35)) which has the property v(x,y,t) is C 2 in (x,y), C 1 in t, 
and satisfies the inequality 

(A.36) sup {\v(x,y,t)\ + \Dv(x,y,t)\ + \D 2 v(x,y,t)\ : (x, y) e D R ) < 00 

T <t<T 

for any Tg < T. In (A . 36)) Dv{x,y,i) denotes the gradient of v{x,y,t) with respect 
to (x,y), and D 2 v{x,y,t) the Hessian with respect to {x,y). Additionally, the func- 
tions v(x,y,t), Dv{x,y,t) are continuous for (x,y) € D Rl t <T. The tangential 

second derivative (y -J^ — x J^j Dv(x,y,t) is also continuous. 

Next we need to establish a Hopf maximum principle (|A.19[) for solutions to 

(EH, (KM- 

Lemma A.l. Suppose vo(x,y), (x,y) € D R , satisfies the conditions of Proposition 
A2, and in addition < Vo(x, y) < 1, (x, y) € D R . Then if vq ^ 0, the solution 
v(x, y, t) of ftA.34\ ), f A. 35)) satisfies the inequalities 

(A.37) < v(x, y, t) < 1, (x, y) € D R , t< T, 



dv 
dy 



e d v 
2 dy 2 



2 dx 2 



= 0, t <T, 
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dv dv 
(A.38) x —( X] y,t)+y—(x,y,t)<0, (x,y)edD R , t <T. 

Proof. The fact that < v(x, y, t) < 1, (x, y) £ D R . t <T, follows by applying the 
argument for the weak maximum principle, Theorem 1 of Chapter 3 of [19] , to the 
quasilinear equation (|A.34p . Similarly one sees that the argument for the strong 
maximum principle, Theorem 2 of Chapter 3 in [19j applies to (|A.34[) . We conclude 
that (j A.37|) holds. Finally (|A.38[) follows by applying the argument of Theorem 3 
of Chapter 3 in [TO] to (TOl) . □ 

The final result we need in order to apply Korevaar's method [14] to prove 
convexity in (x,y) of q e (x,y,t) is in effect a comparison principle for solutions of 
the quasilinear equation (|A.34|) to solutions of the linear equation 

, . . dv , , . dv e d 2 v e' d 2 v 

(A - 39) m +b ^lfy + 2W + 2^ = - 

Lemma A. 2. Assume &(•,•) satisfies il.l]) and let v(x,y,t), (x,y) £ D Rl t < T, 
be a solution of {A . 34\ ) which is C 2 in {x,y) and C 1 in t. Assume further that 
v(x,y,t) extends to a continuous function on Dr x {t < T}. Let w(x,y,t) be a 
second solution to \A . 31$ with similar properties to those of v{x,y,t). Then if for 
some constant M the inequality 

T 



(A.40) J |6(0, s)\ds + A(T - t) + y/e{T - t) < M 

holds, there is a constant C depending only on M such that 

(A.41) \v(0,0,t)-w(0,0,t)\< 

exp [-R 2 /Ce{T - t)] sup {\v(x, y, s) -w(x,y,s)\ :t<s<T, (x,y) G dD R } + 
exp [~k 2 /Ce(T - t)] sup { \v{x, y , T) - w{x, y , T) \ : (x, y) G D k+M nD R }, 

k>0 

provided < e' < e. 

Proof. We set u(x,y,t) = v(x,y,t) — w(x,y,t), and observe from (|A.34p that 
u(x,y,t) satisfies the differential inequality 

du 



(A.42) | dy 

Suppose now that C(x,y,t) satisfies 

dC 



e d 2 u e' d 2 u 
2 W + 2 dx 2 ~ 



8(1 

(A.43) ^ -!%,*)! 



dy 



e d 2 C e'd 2 C n . . „ 

0, {x,y)eD R ,t<T, 



2 dy 2 2 dx 2 

with boundary and terminal data given by 
(A.44) 

C(x, y, T) = u(x, y, T), (x, y) £ D R ; C(x, y, t) = u(x, y, t), (x, y) E dD R , t < T. 

Then by the maximum principle we have that u(x,y,t) > C(x,y,t) for (x, y) S 
D R , t <T. Observe next that C(x,y,t) is the cost function for an optimal control 
problem. Thus 
(A.45) 

C{x,y,t)= inf \e[u(X(T),Y(T),T); T x , y<t > T]+E[u{X{T x<yi t),Y(T X} y it ),t) ; T x ^ t <T]\, 
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where the stochastic process [X(s),Y(s)) satisfies the SDE 

(A.46) dY(s) = X(Y(s), s)ds + y/e dW{s), dX (s) = VF dW (s) , 

and W(-), W'(') are independent copies of Brownian motion. The controller X(y, s) 
satisfies the constraints \X(y, s)\ < \b(y, s)|, y £ R, s < T. The stopping time t x ^ j 
is the first hitting time on ODr for the process (|A.46|) with X(t) = x,Y(t) = y. 

If we argue now as we did in Lemma 3.1 we can see that C(0,0,i) is bounded 
below by the negative of the RHS of (|A.41[) . Thus we obtain a lower bound on 
v(0, 0,i) — w(0, 0, t). Since we can repeat the previous argument with v and w 
interchanged, we also get an upper bound on v(0,0,t) — w(0,0,t), whence (|A.41|) 
follows. □ 



Proposition A. 3. Assume &(•, •) satisfies (1.1]) , and the terminal function vo(x,y) 
in Proposition A2 is log concave and satisfies the boundary condition \Dvq(%, y)\ =/= 
for (x, y) £ dDft. If in addition the function b(y, t) is concave in y for y £ R, t < T, 
then the solution v(x,y,t) of j[A.34\ ), (A . 35]) is also log concave. 

Proof. We again follow the method of Korevaar [14] as given in [9] (see also |10|). 
Thus on setting w(x, y,t) = — \ogv(x, y, t) we see from (|A.34|) that w(x, y, t) satisfies 
the PDE 



(A.47) 



dw e d 2 w e' d 2 w 



dt 2 dy 2 2 dx 2 
where the function B{y 1 t,p) is given by the formula 



-B(y,t,Dw) = 0, 



(A, 



B{y, t, p) = b(y, t) \ Py | + ep 2 J2 + e'p 2 x /2. 



Since B(y, t,p) satisfies the conditions of Theorem 4.1 of [5], the result follows pro- 
vided we can show that w(x,y,t) is convex for (x,y, t) close to the boundary of 
Dr x {t < T}. To see this we argue as in Lemma 2.4 of [14] . Observe that it is 
sufficient to assume D 2 v(x, y, t) is bounded as in (|A.36|) . and not necessarily contin- 
uous as (x, y, t) approaches a boundary point, provided the tangential derivative of 
Dv(x,y,t) remains continuous. To see why this is the case consider a non-negative 
C 2 function / on the half plane H = {(x,z) G R 2 : z > 0}. We assume that / 
extends to a C 1 function on the closure H of H and that / = on dH. In addition 
we assume the boundary behavior at (0,0) of the second derivatives of / is given by 
(A.49) 



lim sup 



d 2 f 



dxdz 



(x,z) 



d 2 f 

< oo, lim — — =■ (x, z) = 0, lim sup 

(a:,»)-(0,0) Ox z (x,z)^(0fl) 



dz 2 



(x,z) 



< oo. 



Now define a function w(x,y) on the domain U = {(x, y) G R 2 : y > x 2 /2} 
by exp[— w(x, y)] — f(x,y — x 2 /2). Then we can see that if df(0,0)/dz > 0, there 
exists S > such that the Hessian of w is strictly positive definite for (x, y) £ UC\Ds- 
The convexity of w(x, y, t) close to the boundary of Dr x {t < T} follows from the 
regularity result Proposition A2 and Lemma Al by analogous argument. □ 



Theorem A. 3. Assume &(•, ■) satisfies (1.1]) and in addition the function b{y,t) is 
concave in y for y 6 R, t <T. Then for t < T the function q e (x, y, t) is convex in 
(x,y) for (x,y) £ R 2 . 
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Proof. Similarly to the proof of Theorem Al, we approximate q e (x, y, t) by functions 
defined on finite domains Dr which are convex by virtue of Proposition A3. To 
specify the terminal function va(x,y), we define a function f{z) for z < 1 by 

(A.50) f(z) = for z<l/2, /(1/2) = /'(1/2) = 0, 

f»t \ exp[-(l-z) 2 /(2z-l)] 

/ (Z) = ^2 ' fOT 12 < Z < L 

(1 - z)^ 

Evidently /(•) is a non-negative increasing C°° convex function which has the prop- 
erty that f(z) + log(l — z) has a converging Taylor expansion about z = 1. Next 
let <? : R — > R be defined by 

(A.51) ffW = 2 4 , 2<0; <?(*) = 0, z>0, 

whence g is a non-negative decreasing C 3 convex function, ft follows from (|A.50I) . 
(|A.51j) that the function vq with domain Dr defined by 



(A.52) v (x, y) = exp [-/(^ 2 + y 2 1 R) - 9{{v - x]/S) 

is C 2 for {x,y) £ Dr with Vo(x,y) = if (x, y) € In addition Vo(x,y) is 

log concave for (x, y) £ and satisfies the non-degenerate boundary condition 
\Dvo(x,y)\ 7^ if (x, y) e 91?^. Hence by Proposition A3 the corresponding- 
solution vs v n(x,y,t) of (IA.34j) . (|A.35jl is log concave in (x,y). 

Next we compare the function vg > R(x,y,t) to a solution of the linear equation 
(|A.39p . Thus let Vs(x, y, t) be the unique bounded solution to (|A.39[) in the domain 
{(x,y,t) : (x, y) S R 2 ,t < T} with terminal condition 

(A.53) v s (x,y,t)=exp[-g([y-x}/5)], (x,y)eR 2 . 

From (|A.5ip one sees that vs(x, y, T) is an increasing function of y for every x £ R. 
The maximum principle implies then that v$(x,y,t) is also an increasing function 
of y for every x £ R, t < T. Thus v$(x, y, t) is also a solution to (|A.34j) . We may 
therefore use Lemma A2 to compare the functions v$ and Vs t R- In view of the fact 
that < vs < 1 and the properties of the function / of (|A.50[) . we conclude from 
flXHJ) , (fX33l) that 

(A. 54) limsup {\v s (x,y,t) - vs,R(x,y,t)\ : (x,y) £ D Ro , T < t < T] = 0, 

for any R > 0, T < T. 

We conclude from (IA.54j) and the log concavity of vg y R that the function v${x, y, t) 
is also log concave in (x,y) for (x,y) £ R 2 , t <T. Observe here that we are using 
the strong maximum principle to conclude that v$(x, y, t) > 0, (x, y) £ R 2 , t < T . 
Next we see that the function v(x, y, t) = lim^o vs{x, y, t) is the unique bounded 
solution of (| A. 39(1 which has terminal data v(x,y,T) — if y < x, v(x,y,T) = 1 
if y > x. Thus v(x,y,t) = v s ,e' ( x , y, t) is log concave for [x, y) £ R 2 and t < T. 
Finally we conclude the convexity of q e (x, y, t) in (x, y) by noting that the function 
u e (x,y,t) of (|I.2p . (|1.3p satisfies u E (x,y,t) = linv^ v s , e >(x, y,t). □ 
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